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SUMMARY 

This  research  addresses  two  related  problems  of 
multivariate  statistical  analysis.  First,  the  effects  of  a 
multivariate  time  series  on  the  MANOVA  power  function  are 
investigated  through  the  use  of  an  experimental  design. 

Second,  a generalized  procedure  is  developed  for  incorporating 
the  multivariate  time  series  into  the  MANOVA  power  function 
so  that  the  effectiveness  of  ANOVA  and  MANOVA  models  in 
evaluating  command  and  control  systems,  on  the  basis  of 
powers  of  the  tests,  may  be  made. 

In  order  to  make  the  analysis  possible,  a procedure 
to  determine  the  power  of  MANOVA  test  was  required.  The 
MANOVA  power  function  is  not  known  in  a closed  or  usable 
form;  consequently,  a Monte  Carlo  procedure  was  used  to 
determine  the  power  of  the  MANOVA  test.  The  maximum  likeli- 
hood form  of  the  MANOVA  test  statistic  was  utilized  due  to 
its  ease  of  computation.'^ 

Previous  research  has  found  the  following  general 
results  to  hold  for  the  MANOVA  power  function: 

1.  Power  is  a decreasing  function  of, the  dimension 
of  the  multiresponse. 

2.  Power  is  an  increasing  function  of  the  size 
departure  from  the  null  hypothesis. 

3.  Power  is  an  increasing  function  of  sample  size. 


4.  Power  is  an  increasing  function  of  the  probability 
of  Type  I error. 

5.  PoweT  is  an  increasing  function  of  -log  |P|, 
where  P is  the  correlation  matrix  of  the  multi- 
response. 

An  investigation  of  the  effects  of  a multivariate  time  series 
on  the  MANOVA  power  function  would  have  little  meaning 
without  simultaneously  considering  the  other  factors  which 
influence  the  power  function.  Two  full  2^  factorial 
experiments,  using  the  factors  in  2-5  above  and  exponentially 
decaying  autocorrelated  response  vectors  as  factors,  were 
run  and  analyzed  using  ANOVA.  The  results  verify  statements 
2-5  and  indicate  the  MANOVA  power  is  an  increasing  function 
of  the  autocorrelation  coefficient.  In  addition,  many  two 
factor  interactions  were  found  to  be  significant  indicating 
an  extremely  complex  interrelationship  between  the  various 
factors . 

The  power  of  the  MANOVA  appears  to  be  a decreasing 
function  of  the  dimension  of  the  response,  as  in  1 above. 

It  was  found  that  the  dimension  of  the  response  could  not  be 
separated  from  the  other  factors  and  thus  the  two  experiments 
were  run  with  the  dimension  of  the  response,  p,  set  at  2 and 
3.  There  is  a decrease  in  the  power  from  p = 2 to  p = 3 , 
with  other  factors  held  constant,  lending  support  to  the 
hypothesis;  however,  there  is  no  statistical  evidence  to 
support  the  statement. 
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To  accomplish  the  second  objective  a procedure  is 
proposed  which  uses  the  MANOVA  Monte  Carlo  procedure,  for 
comparing  the  effectiveness  of  the  ANOVA  with  MANOVA  for  a 
multivariate  time  series.  An  example  of  the  use  of  this 
procedure  is  given.  A FORTRAN  IV  listing  of  the  MANOVA 
Monte  Carlo  power  program  is  also  included. 
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CHAPTER  I 

INTRODUCTION 
Background 

Department  of  the  Army  Major  Systems  Acquisition  Procedure 
The  acquisition  of  major  defense  systems  by  the 
Department  of  Defense  is  accomplished  through  the  use  of  a 
well  defined  decision  procedure  with  safeguards  to  prevent 
the  acquisition  of  unsatisfactory  or  unnecessary  systems. 

The  procedure  used  by  the  Department  of  the  Army  closely 
parallels  that  of  the  Department  of  Defense  and  is  an 
essential  element  of  the  Department  of  Defense  acquisition 
procedure.  Measures  are  taken  to  insure  that  only  those 
systems  for  which  a valid  need  exists  are  acquired  by  the 
Department  of  Defense.  The  measures  are  discussed  at  some 
length  in  various  Department  of  Defense  directives  [7,22,23]. 

After  the  Army  staff  has  determined  a valid  require- 
ment exists  for  a proposed  system,  the  system  must  pass 
through  three  phases  prior  to  full  production.  The  first 
phase  is  the  conceptional  development  phase  during  which  the 
system  hardware  is  in  an  experimental  prototype  configuration. 

The  second  phase  is  the  full  scale  development  phase  during 
which  the  systems  hardware  is  in  an  engineering  development 
prototype  configuration.  The  third  phase  is  the  full  scale 
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development  phase  during  which  the  systems  hardware  is  in  a 
production  prototype  configuration  [7]. 

At  each  phase  transition  point  the  Secretary  of 
Defense  may  terminate  the  system,  permit  the  system  to  proceed 
to  the  next  phase,  or  retain  the  system  in  its  present  phase 
for  remedial  action  [23].  To  assist  the  Secretary  of  Defense 
in  these  decisions  a permanent  advisory  body,  the  Defense 
Systems  Acquisition  Review  Council  (DSARC),  is  in  being. 

The  DSARC  provides  information  and  recommendations  to  the 
Secretary  of  Defense  whenever  program  decisions  become 
necessary.  A scheduled  meeting  of  the  DSARC  precedes  the 
Secretary  of  Defense's  decision  concerning  the  disposition 
of  a system  at  each  phase  transition  point. 

Within  the  Department  of  the  Army  there  exists  a 
permanent  advisory  body,  the  Army  Systems  Acquisition 
Review  Council  (ASARC) , which  provides  the  DSARC  with  the 
Army's  recommendations  at  each  phase  in  the  acquisition 
process.  The  ASARC  is  chaired  by  the  Vice  Chief  of  Staff  of 
the  Army  and  has  as  its  principal  members  the  Commander 
U.  S.  Army  Material  Command,  the  Commander  U.  S.  Army 
Training  and  Doctrine  Command,  the  Chief  of  Research, 
Development,  and  Acquisition,  and  various  assistant 
secretaries  of  the  Army.  Scheduled  meetings  of  the  ASARC 
precede  those  of  the  DSARC. 

Requirement  for  Testing 


Normally  three  distinct  Developmental  Tests  (DT)  and 
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Operational  Tests  (OT)  are  conducted  for  each  major  system. 

One  DT  and  OT  is  conducted  prior  to  the  three  meetings  of 
the  ASARC  and  DSARC.  Results  of  the  DT  and  OT  at  each  phase 
are  reported  directly  to  the  ASARC  for  inclusion  in  its 
recommendations  to  the  DSARC.  The  DT  and  OT  are  required  to 
be  evaluated  independently  of  each  other  [7]. 

DT  is  conducted  to  determine  if  the  engineering  design 
and  development  is  complete,  to  determine  if  design  risks 
have  been  minimized,  and  to  determine  if  the  system  will 
meet  its  specifications.  OT  is  conducted  to  estimate  the 
system's  military  worth  in  comparison  with  competitor  systems, 
to  determine  its  operational  effectiveness  and  suitability 
in  its  environment,  and  to  determine  if  the  system  requires 
modification  [7] . This  research  will  be  concerned  with  OT 
only. 

Operational  Testing 

The  U.  S.  Army  Test  and  Evaluation  Agency  is  desig- 
nated as  the  agency  responsible  for  OT  on  major  defense 
systems  [5,6].  OT  will  emphasize  the  comparative  evaluation 
of  the  new  system  with  existing  systems  and  competitor 
developmental  systems.  The  OT  agency  is  independent  of  the 
developing/procuring  and  using  organization.  OT  is  accom- 
plished using  typical  users/operators,  crews,  or  units  in  as 
realistic  an  operational  environment  as  possible.  OT  is 
conducted  to  provide  the  necessary  data  to  estimate: 

1.  The  military  utility,  operational  effectiveness, 
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and  operational  suitability  of  the  system. 

2.  The  system's  desirability,  operational  benefits, 
and  burdens  from  the  user's  viewpoint. 

3.  The  need  for  modification  of  the  system. 

4.  The  adequacy  of  doctrine,  organization,  operating 
techniques,  tactics,  and  training  for  the  system. 

5.  The  adequacy  of  maintenance  support  for  the  system. 

6.  The  systems  performance  in  a countermeasures 
environment . 

Command  and  Control  Systems 

In  recent  years  the  U.  S.  Army  has  expended  a great 
deal  of  money  and  time  to  develop  and  deploy  sophisticated 
tactical  command  and  control  systems.  Tactical  command  and 
control  systems  currently  under  development  include  the 
Tactical  Operations  System  (TOS) , a division  level  command 
and  control  system;  TSQ-73,  an  air  defense  command  and  control 
system;  and  TACFIRE,  air  artillery  fire  control  and  fire 
support  command  and  control  system. 

Measures  of  effectiveness  employed  in  the  evaluation 
of  command  and  control  systems  vary;  however,  the  measures 
of  effectiveness  are  rarely  independent  [58].  For  instance, 
the  fraction  of  available  time  passed  to  subordinate  echelons 
and  time  required  to  prepare  staff  actions,  two  possible 
measures  of  effectiveness,  are  highly  correlated  [58]. 

Both  analysis  of  variance  (ANOVA)  and  multivariate 
analysis  of  variance  (MANOVA)  appear  to  be  appropriate 
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statistical  methods  to  be  used  for  analysis  of  command  and 
control  experimental  data.  Recent  research  has  developed  a 
methodology  for  determining  which  statistical  method,  or 
combination  of  methods,  is  most  appropriate  for  a particular 
system  [16].  This  research  has  not,  however,  considered  that 
in  addition  to  the  various  measures  being  correlated,  that 
in  the  case  of  computer  assisted  systems  they  may  also 
constitute  a multivariate  time  series.  A promising  area  of 
research  appears  to  exist  in  developing  a methodology  for 
identifying,  analyzing,  and  incorporating  this  additional 
information  into  the  methodology  developed  by  Burnette  for 
determining  the  appropriateness  and  effectiveness  of  ANOVA 
and  MANOVA  in  the  analysis  of  command  and  control  systems 


[16]. 


Objective,  Procedure  and  Scope 

The  primary  objective  of  this  research  is  to  investi- 
gate the  effects  of  a multivariate  time  series  on  the  MANOVA 
power  function  and  develop  a methodology  for  incorporating 
time  series  information  into  the  MANOVA  power  generator 
previously  developed  by  Burnette  [16].  Using  the  methodology 
developed  by  Burnette  for  comparing  the  effectiveness  of 
the  ANOVA  and  MANOVA  the  methodology  will  be  demonstrated. 

The  scope  of  this  research  will  be  limited  by  four 
assumptions.  First,  due  to  the  standard  scenarios  used  in 
OT,  only  the  fixed  effects  model  of  the  ANOVA  and  MANOVA  will 
be  considered  appropriate.  Second,  equal  cell  sample  sizes 
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only  will  be  considered  appropriate.  Third,  due  to  the 
high  cost  and  time  factor  in  training  more  than  one  command 
and  staff  group  to  operate  each  alternative  command  and 
control  system,  operators  of  the  alternative  system  will  not 
be  considered  a factor.  Fourth,  for  practical  reasons  only 
stationary  multivariate  time  series  will  be  considered.  To 
limit  the  computer  programming  involved  only  two  factor 
completely  crossed  designs  will  be  considered.  In  addition, 
only  those  elements  of  ANOVA  necessary  to  demonstrate  the 
methodology  will  be  reviewed.  Burnette  has  an  excellent 
discussion  of  the  ANOVA  model  if  additional  information  is 
required . 


CHAPTER  II 


REVIEW  OF  APPLICABLE  STATISTICAL 


RESULTS  AND  TECHNIQUES 


Introduction 


This  chapter  is  a brief  review  of  statistical 
results  and  techniques  necessary  to  develop  a methodology 
for  use  in  comparing  the  applicability  of  ANOVA  with  MANOVA 
The  essential  elements  of  time  series  analysis  necessary  to 
incorporate  this  information  into  the  MANOVA  power  function 
will  also  be  reviewed. 


Univariate  Analysis  of  Variance 


The  appropriate  univariate  statistical  model  for 
comparing  several  systems  is  analysis  of  variance  (ANOVA) 
The  model  and  assumptions  for  the  two-factor  case  will  be 
reviewed.  These  results  may  be  easily  extended  to  the 
general  case.  Only  completely  crossed  designs  and  fixed- 
effects  models  will  be  considered. 


The  two-factor  fixed-effects  ANOVA  model  is 


y + or  ♦ g. 
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y is  the  mean  effect  common  to  all  observations,  or  is  the 


effect  due  to  level  i of  factor  A,  3^  is  the  effect  due  to 


level  j of  factor  B.  is  the  effect  due  to  the  inter- 


action of  level  i of  factor  A and  level  j of  factor  B. 


e...  is  the  effect  due  to  random  error  in  the  k th  observa- 
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tion  with  factor  A at  level  ^ and  factor  B at  level  j [34] 


The  following  assumptions  are  necessary  for  estimation 
inference  and  hypothesis  testing. 
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Appropriate  hypotheses  we  may  want  to  test  include: 


Hio: 

No  effect 

due 

to 

factor 

A or 

“i 

= 0 

against 

Hir 

Not  H10 

H20: 

No  effect 

due 

to 
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B or 
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= 0 

against 

H21 : 

Not  H20 

H30 ' 

No  effect 

due 

to 

interaction 

or 

Yij 

i = 1 , . . . , a 
j = 1,  ....  b 


against 


Not  H 


30 


The  ANOVA  test  procedure  consists  of  partitioning  the 
total  variation  in  the  observations  into  the  contributions 
due  to  main  effects,  the  interaction,  and  the  error  component 
For  the  two  factor  model  the  partitioning  is: 


SST  “ SSA  + SSB  + SSAB  + SSE ’ 


(2.6) 


Methods  for  determining  the  sums  of  squares  are  well  known 
and  will  not  be  elaborated  on  here  [34], 

The  test  statistic  for  use  in  the  ANOVA  model  is 
based  upon  the  F distribution.  The  null  hypothesis,  say 
H.n:  no  effect  due  to  factor  A,  would  be  rejected  if: 
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F0  " SSc/ab  (n-l'J  > Fa,a-l,ab(n-l)  (2,7) 

where  F^  a ^ ab(n-l)  Fs  t*ie  uPPer  Cl- cx)  percentage  point  of 
the  F distribution  with  (a-1)  numerator  degrees  of  freedom 
and  ab(n-l)  denominator  degrees  of  freedom  [34].  Similar 
test  statistics  can  be  constructed  for  the  other  hypotheses. 

When  the  ANOVA  model  is  used  the  test  for  interaction 
effect  should  be  made  first.  If  the  interactions  are  not 
found  to  be  significant  then  we  may  test  the  hypothesis  on 
the  main  effects.  However,  if  we  reject  the  hypothesis  of 
no  interaction  effect  then  tests  on  main  effects  may  have 
little  meaning.  For  a further  discussion,  see  Press  [43]. 

Power  of  the  Analysis  of  Variance 
When  constructing  hypotheses  there  are  two  probability 
measures  we  are  concerned  with.  First,  the  probability  of 
rejecting  the  hypothesis  given  it  is  true;  or  a.  Second, 
the  probability  of  rejecting  the  hypothesis  given  it  is 
false,  or  the  power  of  the  test,  (1-g).  It  has  been  shown 
that  the  alternative  hypothesis  is  distributed  as  a non- 
central F distribution.  Pearson  and  Hartley  [34]  have 
constructed  charts  which  plot  the  probability  of  type  II 
error  (1-power)  for  various  VI,  V2,  a,  and  parameter  $, 
where  for  the  case  of  H1Q 
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VI  = a- 1 


V2  = ab(n-l) 


,2  _ 2 . 

$ - - X 


n Z a. 


(2.8) 


£ a. 


Since  a is  seldom  known  the  ratio  of 
desire  to  detect  is  normally  used. 


which  you 


Multivariate  Analysis  of  Variance 
Model  and  Required  Assumptions 

The  appropriate  multivariate  model  for  comparing 
several  multiresponse  systems  is  the  multivariate  analysis 
of  variance  (MANOVA) . The  model  and  assumptions  for  the 
two-factor  case  will  be  reviewed  and  may  easily  be  extended 
to  the  general  case.  Only  the  fixed-effects  model  will  be 
considered . 

The  two-factor  fixed-effects  model  is 


Xijk  ■ H * Si  * 5j  + lij  * Sijk 
(Pxi)  (Pxi)  (Pxi)  (pxi)  (pxihpxi) 
i If  •••f  3 ) j If  t • t f bf  lc  If  • • « f n 


(2.9) 


> 


i- 
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The  vector  y is  the  effect  common  to  all  observations.  The 
vector  is  the  effect  due  to  level  i of  factor  A,  the 


vector  is  the  effect  due  to  level  j of  factor  B,  and 


the  vector  Yjj  is  the  interaction  effect  due  to  level  i of 


factor  A and  level  j of  factor  B.  The  vector  e...  is  the 

1 j K 


effect  due  to  the  random  error  with  factor  A at  level  i and 
factor  B at  level  j on  the  k th  observation  [46,52]. 

Several  assumptions  are  necessary  for  estimation, 
inference,  and  hypothesis  testing.  The  following  assumptions 
are  made  concerning  the  effects  due  to  levels  of  factors 
and  interactions: 


E a-  - <p  ~ E 
i=l  -1  j=l 


(2.10) 


£ • • • » b 

i = l ~1J 


(2.11) 


Z y ■ • = 

j-1 


i 1,  . . . , a 


(2.12) 


e^k  are  independently  distributed  N (<f> , Z ) , z > <j> . 
Hypothesis  Testing 

The  hypotheses  we  might  want  to  test  include: 


H 


10 


No  effect  due  to  factor  A or  = <t>  i = 1 , ...,a 


against 


Hll:  Not  H10 


13 


against 


No  effect  due  to  factor  B or  gj  = <j>  j = 1 , 


Not  H20 

No  effect  due  to  the  interaction  or  y^j  = 

i = 1,  . 
j =1, 


against 


H31:  Not  H3q 

There  are  three  widely  used  MANOVA  hypothesis  testing 
criteria.  They  are  the  likelihood  ratio  criterion,  the 
trace  criterion,  and  the  largest  characteristic  root  [44]. 

The  likelihood  ratio  criterion  will  be  used  due  to  its 
ease  of  computation  and  attendant  power  considerations  [54]. 
The  likelihood  ratio  criterion  requires,  for  the  two-factor 
case,  that  the  dimension  of  the  response,  p < ab(n-l)  [46]. 

The  MANOVA  hypothesis  testing  procedure  consists  of 
partitioning  the  total  variation  of  the  observations  in  a 
manner  similar  to  the  ANOVA  partitioning.  Specific  computa- 
tional formulae  will  not  be  given;  however,  relevant  matrices 
will  be  defined. 

E --matrix  of  error  sums  of  squares  and  cross  products. 

HI- -matrix  of  factor  A sums  of  squares  and  cross 
products . 

H2- -matrix  of  factor  B sums  of  squares  and  cross 
products . 


H3--matrix  of  interaction  sums  of  squares  and  cross 


products 


The  likelihood  ratio  test  for  H 


^ q ■ o^i  ^ is  to 


reject  H1Q  if 


< Constan". 


(2.13) 


under  H, 


->  = <3?{Vqi,n} 


where  p is  the  dimension  of  the  response,  = a-1,  and 


n = ab(n-l).  Thus,  we  reject  H, n if  the  test  statistic  is 


less  than  U . The  values  of  U are  determined  using 

P , qn  , n 

a second  order  x approximation  developed  by  Box  [10,46]. 


The  test  statistics  for  and  are  found  similarly. 


The  hypothesis  of  no  interaction  effect  is  conducted 


first.  If  we  fail  to  reject  this  hypothesis,  we  would  then 


test  the  hypotheses  on  the  main  effects.  If  we  reject  the 


hypothesis  of  no  interaction  effects,  we  must  use  other 


techniques  to  determine  if  the  main  effects  are  significant 


Power  of  the  Multivariate  Analysis  of  Variance 


The  power  function  of  the  MANOVA  test  criteria  is  not 


available  in  closed  form.  Recently,  the  noncentral 
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distributions  of  the  largest  characteristic  root  and  likeli- 
hood ratio  statistics  have  been  studied;  however,  to  date 
research  has  not  yielded  a useable  power  function  for  the 
MANOVA  tests.  Roy,  Mikhail  [53],  and  others  have  shown  that 
the  MANOVA  power  is  a monotonically  increasing  function  of 
the  noncentrality  parameters  of  the  criteria  distribution 
[53].  Gnanadisikan  [54],  using  Monte  Carlo  methods,  showed 
that  the  MANOVA  test  power  is  monotonically  decreasing  with 
increasing  dimension  of  the  response,  p,  and  is  monotoni- 
cally increasing  with  increasing  probability  of  type  I 
error.  The  lack  of  a usable  power  function  has  resulted  in 
most  research  being  accomplished  via  Monte  Carlo  simulations. 

Correlation  Analysis 

Simple  Correlation 

If  multivariate  statistical  analysis  is  to  be 
appropriate  it  is  necessary  to  have  at  least  two  measures 
which  are  significantly  correlated.  The  most  elementary 
expression  of  correlative  structure  involves  the  simple 
correlation  coefficient,  p.  Let  , y^,  ...,  yn  be  n 
independent  observations  of  a p-dimensional  random  vector  Y. 
The  covariance  between  the  i th  and  j th  component  of  Y, 

Y1  and  Y^  is 


o..  = COV (Y1 ,Y^ ) = E[(Y1-EY1)(YJ-EYJ)]  (2.14) 


r 


where  a—  is  the  variance  of  Y . The  pxp  matrix  of 
population  covariances  is  defined  as 


5 - (ai3) 


(2.15) 


The  correlation  coefficient  between  Y1  and  Y-*  is  defined  as 


ij 


(0u  °jj) 


T77 


-1  < Pij  < 1 


(2.16) 


The  pxp  matrix  of  population  correlation  coefficients  is 
defined  as 


P - (P4j)  (2.17) 

The  sample  covariance  matrix,  S,  and  the  sample 
correlation  matrix,  R,  are  found  by  replacing  the  population 
covariances  and  correlations  with  their  maximum  likelihood 
estimators.  Thus,  the  sample  correlation  coefficient  between 
Y*  and  Y^  is 


r.  . 
il 


S.  . 
ii. 


(SU  Sj,) 
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-1  5 rtj  ; 1 


(2.18) 


where 


S.j  is  the  maximum  likelihood  estimator  of  . 
Fisher  has  shown  that  under  the  assumption  of  joint 


normality  the  transformation 


I 


Z = tanh  r. 

ij 


produces  an  asymptotic  normal  variate  with  mean 


1 + p.  . 

q s 1/2  log  (.-32.) 


and  variance 


Var  m = ^ 

when  N,  the  number  of  observations,  becomes  large. 

Using  the  Z-transform  it  is  possible  to  test 


H0  : Pij  = Po 


against 


H,  : p. . / p 

1 Kij  T Mo 


The  hypothesis  is  rejected  if 


Z-q0|  /fTT  > Zo/2 


(2.19) 


(2.20) 


(2.21) 


(2.22) 


where  qQ  is  the  z-transform  of  r = pq  and  Za/2  is  the  upper 
100  (1  -a/2)  percentage  point  of  the  standard  normal 


... 
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distribution  [44]. 

Multiple  Correlation 

For  a p -dimensional  response  vector  the  multiple 
correlation  coefficient,  P^,  of  one  response  component,  P^, 
with  a linear  combination  of  the  other  P-1  response 
components  is  defined  as 


Pi  = max  corr  (y^a'X) 


(2.23) 


where  a is  a P-1  dimensional  contrast  vector  and  X is  the 
vector  of  the  other  P-1  response  variables.  Pi  is  the 
largest  possible  correlation  between  Y1  and  any  linear 
combination  of  the  remaining  P-1  response  variables.  The 
sample  multiple  correlation  coefficient  may  be  determined 
from  either  the  sample  correlation  matrix  or  the  sample 
covariance  matrix.  To  find  the  multiple  correlation  of 
Y1,  R1 , rearrange  the  appropriate  matrix  by  replacing  the 
1st  response  with  the  i1"*1  response  and  partition  the  matrix, 
When  using  the  sample  covariance  matrix  the  partitioning  is 
as  follows 


(2.24) 


where  is  now  S^,  S22  is  the  P-1  covariance  matrix  of 

the  remaining  response  components,  and  is  the  P-1  vector 


WPi  tgiau 


*W5PI 
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of  sample  correlations  between  response  i and  the  other  P-1 
response  components.  With  the  matrix  so  partitioned  the 
multiple  correlation  coefficient,  R.^ , is  defined  as 


d2  _ „2  _ 5l2  ~22  §12 

Ki  " K1  “ 5 

bll 


(2.25) 


The  appropriate  hypothesis  to  determine  if  Y1  is 
independent  of  the  remaining  response  components  is  to  test 


H0  : pi  = 0 


against 


Hj  : p > 0 


The  hypothesis  would  be  rejected  if 


1 


Rf  (n-p) 

Q = -=— 7 > F . 

1-R-  (P-1)  a,p-l,n-p 


(2.26) 


where  n is  the  number  of  observations,  p is  the  dimension  of 
the  response,  and  F is  the  upper  100  (1-a)  percentage  point 
of  the  F distribution  [46], 

Independence  of  K Variates 

To  determine  if  a set  of  k multivariate  normal 
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response  variates  are  independent  can  be  accomplished  by 
testing 


against 


H, 


: P = I 


H1  : P t 1 


where  P is  the  k x k population  correlation  matrix  and  I is 
the  k x k identity  matrix.  The  null  hypothesis  is  rejected 
if 

Xo  - - (N-1  - ^ 1°S  l?l  > X.,1/2  k (k-1)  (2-27) 


where  N is  the  number  of  independent  observations,  R is  the 

2 2 

k x k sample  correlation  matrix,  and  y is  the  upper-tail  y 
distribution  [44].  This  test  is  appropriate  prior  to  any 
multivariate  analysis. 

Independence  of  k sets  of  Variates 

In  addition  to  determining  if  a set  of  k responses 
are  independent,  it  will  also  be  of  interest  to  determine 
if  k sets  of  multivariate  normal  variates  are  mutually 

x I.  1. 1. 

independent.  If  the  j of  the  k1"  sets  contains  P^ 
variates,  then  the  gross  covariance  matrix  may  be  partitioned 
into  submatrices  E^j  of  dimension  P.  x Pj . The  appropriate 


hypothesis  to  test  is 


H0  : ?ij  = <J>  for  1 f1  J 


against 


H1  : hj  * ♦ 


i t j. 


For  N independent  observations  from  a multivariate  normal 
population,  compute  R,  the  sample  correlation  matrix,  and 
partition  as  above.  To  test  HQ  use  the  test  statistic 


Mi  1 1^22*  — i ekk  i 


(2.28) 


It  has  been  shown  the  statistic 


(N-l)  _ 2 

hr1  l0«  v ' x0,f 


(2.29) 


where 


.-1  _ , (2S1  + 3S2) 

J-  “ — «i  n 


(2.30) 


S2/2 


( E P.)J 
i=l  1 


(2.31) 
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h'  would  be  rejected  if  Xn  > X™  r [10,44]. 

U vJ  Ot  j I 

Stationary  Multivariate  Time  Series 
Multivariate  Time  Series 

When  more  than  one  measure  of  a time-varying  process 
is  required  to  properly  describe  its  behavior,  then  the 
process  is  called  a multivariate  (vector,  multidimensional) 
time  series.  Thus,  the  position  or  state  of  the  process  at 
each  instant  of  time  can  be  represented  by  a vector  of  time 
dependent  measurements 

(x1(t) 
x2(t) 

Xp(t) 

only  those  multivariate  time  series  for  which  the  components 
are  univariate  time  series  will  be  considered.  This 
restriction  appears  to  have  little  effect  on  the  current 
investigation  since  it  is  reasonable  to  expect  each  component, 
or  subset  of  the  components,  to  exhibit  this  characteristic. 
Univariate  Stationary  Time  Series 

A stochastic  process  is  said  to  be  strictly  stationary 
if 


EX (t+x)x (t)  = EX(t)x(0)  = C(t)  -oo<t<oo  (2.34) 

Thus,  the  mean  values  are  constant  in  time  and  the  covariances 
depend  on  the  time  displacement  t,  but  not  on  t.  The 
function  C(x)  is  called  the  autocovariance  function. 

If  condition  (2.32)  is  discarded  and  we  assume  only 
that  the  random  variables  of  the  process  have  the  property 

Var  x(t)  = C(0)  < °°  (2.35) 


and  satisfy  properties  (2.33)  and  (2.34),  then  the  process  is 
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said  to  be  weakly  stationary.  Since  the  joint  multivariate 
normal  distributions  of  a Gaussian  process,  sometimes  called 
a normal  process,  depend  only  on  the  mean  vector  and 
covariance  matrix  of  the  random  variables  and  these  functions 
have  properties  (2.33)  and  (2.34),  the  joint  distributions 
will  have  property  (2.32).  Thus,  stationarity  and  weak 
stationarity  are  equivalent  for  normal  processes  [41]  . 
Identification  of  Time  Series 

There  are  a number  of  statistical  tests  available  to 
determine  if  a set  of  time  indexed  observations  constitute 
a significant  autoregressive  process  or  are  pure  white 
noise  [30].  Perhaps  the  simplest  and  most  commonly  used 
procedure  is  periodogram  analysis . Let 

P 

Xt  = Z (ay  cosAt  + bt  sin  X-Vt)  + et  (2.36) 


where  a , b , and  \ are  real  constants  with  0 < X < n 
V V v v 

and  et  is  pure  white  noise.  We  desire  to  detect  the  periods 
2tt/Av  that  have  been  masked  by  the  random  disturbances  e^. 
For  this  purpose  the  following  statistic  has  been  proposed. 


v*)  = 


1 

rifn 


n 

Z 

t=l 


Xt  e 


- iXt 


1 

Ttt" 


a2(x) 


B4(A)  (2.37) 


where 


A(X)  = ^ Z xt  cos  tX 

b(x)  = VI  ^ ; 

™ t=l 


sin  tX 
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(2.38) 

(2.39) 


I n ( X ) is  called  the  periodogram  and  is  suggested  by  Fourier 
analysis  treating  the  time  series  as  if  it  were  just  the 
undisturbed  trigometric  sum. 

R.  A.  Fisher  developed  a test  procedure  to  determine 
the  significance  of  the  periods  of  the  periodogram.  Fisher's 
null  hypothesis  is  that  the  process  has  no  period,  that  is 


Xt  = e^,  and  the  e's  are  distributed  normally  with  unknown 
mean  m and  variance  cr2. 

Let  the  number  of  observed  values  be  odd,  say  n = 2m+l, 
and  consider  the  m values  of  the  periodogram  at  points 
Lr  = 2iTr/(2m+l),  r=l,  ...,  m.  Due  to  the  orthogonality  of 
the  trigometric  coefficients  (2.38)  and  (2.39),  the 
stochastic  variables 

A(Lr)  , r = 1,  . . . , m 
B(Lr) , r = 1,  . . . , m 

are  2m  independent  normal  variables  with  mean  zero  and 
2 

variance  a . Hence 


S A2(L  l+B2fL  1 


2 

are  independent  X -variables.  Define 


max  Si , i = 1 , 2 , . . . ,m 

g = — (spv...+s-m) (2<41) 

where  the  values  of  are  computed  using  (2.40).  The 
distribution  of  g under  the  null  hypotheses  is 

P(g>X)  = m(l- X)m  l - (1-2 X) m ~ 1 + 

+ m(m3;2('m~2')  d-SX)®"1  - ...  (2.42) 


where  the  summation  should  be  extended  as  long  as  the  terms 
in  the  brackets  are  positive.  The  null  hypothesis,  no 
period  present  is  rejected  if  g > gp , where  gp  is  some 
appropriate  percentile  of  the  distribution  given  by  (2.42) 
[30]. 

Parameterization  and  Estimation  of  Multivariate  Time  Series 
Once  it  has  been  determined  that  a time  series  is  not 
only  noise,  it  is  important  to  determine  the  parameters 
which  fully  describe  the  system.  For  a discrete  time  series 
the  system  is  adequately  described  by  the  matrix 


1,1^ 

C1 , 2 

...  Clpp(x) 

2 , 1 ^ 

C2 , 2 ^ 

...  C2>p(T) 

p,i(t) 

CP.2(t) 

•••  s> 

(2.43) 


where  C . . ( x)  is  the  auto-covariance  of  the  i 
J J 

and  C.,(x)  is  the  cross -covariance  of  the  jt 


component 


definite  matrix 


components 


For  the  purpose  of  estimation  usually  at  least  50 
observations  are  necessary.  In  addition,  for  useful  results 


only  the  first  K £ N/4  autocovariance  and  crosscovariance 
coefficients  are  useful  [381.  The  theoretical  autocorrelation 


for  a p -dimensional  multivariate  time  series  is 


The  theoretical  autocorrelation  function  is  never  known  with 


certainty  and  must  be  estimated.  A satisfactory  estimate  of 
C. . (t)  is  the  sample  autocorrelation  function. 


where  N is  the  number  of  observations,  i is  the  component  of 


time  time  series,  and  x is  the  lag.  The  crosscorrelation 


function  may  be  estimated  as  follows 
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where  N is  the  number  of  observations,  i and  j are  the 
components,  and  t is  the  lag. 

Within  the  literature  there  are  a number  of  statistical 
tests  available  for  the  analysis  of  multivariate  time  series. 
For  example,  test  statistics  similar  to  (2.19),  simple 
correlation,  and  (2.26),  multiple  correlation,  may  be 
constructed.  However,  these  tests  are  based  on  spectral 
distributions  that  are  specified  in  the  frequency  domain  and 
are  not  particularly  relevant  to  the  current  development. 

If  the  reader  is  interested,  an  excellent  discussion  is 
contained  in  [41]  . 

Generation  of  Multivariate  Time  Series 
Generation  of  Univariate  Normal  Random  Variates 

To  investigate  the  MANOVA  power  function  in  the 
presence  of  a multivariate  time  series  it  will  be  necessary 
to  generate  a multivariate  time  series.  In  order  to 
generate  these  time  series  we  require  a procedure  to  generate 
independent  univariate  normal  deviates.  A number  of 
procedures  are  available,  however,  the  method  proposed  by 
Box  and  Muller  appears  to  be  the  most  efficient  [45] . Let 
IT  and  be  independent  deviates  from  a uniform  (0,1) 

distribution;  these  deviates  can  be  obtained  from  any  valid 
uniform  deviate  generator.  To  generate  the  N(y,o  ) variates 
the  uniform  deviates  are  transformed  as  follows: 


4 
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Xj  = p+  ( - 2ct2  log  U.)1/2  cos(2irUj  + 1)  (2.46) 

Xj  + 1 = y+ ( - 2o2  log  U^172  sin(2TTUj  + 1)  (2.47) 

2 

X^.  and  + i will  be  independent  variates  from  N(y,cr  ) [13]. 
Generation  of  Multivariate  Time  Series 

There  are  two  specific  cases  under  which  we  may 
desire  to  generate  multivariate  time  series.  First,  it  may 
be  desired  to  generate  a multivariate  time  series  based  on 
a subjective  estimate  of  the  autoregression  of  X^  on  X^ 

This  may  occur  when  insufficient  observations  are  available 
to  accurately  determine  the  autocorrelation  and  cross - 
correlation  structure  of  the  response  but  it  is  felt  the 
structure  does  exist.  Second,  sufficient  observations  are 
available  and  all  parameters  have  been  determined.  Each 
procedure  will  be  developed  below. 

When  only  a subjective  estimate  of  the  autoregressive 
structure  of  the  time  series  is  available  a rather  simple 
procedure  may  be  developed  for  generating  the  time  series. 

In  order  to  generate  p -dimens ional  random  vectors  from  the 
multivariate  normal  population  N(y,£)  we  use  a fundamental 

theorem  of  multivariate  analysis.  If  (Z^,  Z ^ Z^ ) are 

p independent  observations  from  N(0,1),  then  the  p-dimensional 
vector,  X from  N(y,£)  may  be  represented  as 


I 
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X = C Z + U (2.48) 

where  C is  a unique  lower  triangular  matrix  satisfying 
(2.49)  . 


I - C C'  (2.49) 

The  matrix  C may  be  computed  by  the  routine  reported  by 
Scheuer  and  Stoller  [50] . 

We  may  generate  autocorrelated  vectors,  each  with  the 
same  autoregressive  structure  and  exponential  decay,  by  a 
simple  change  to  the  above  procedure.  For  the  univariate 
case  it  is  known  that  exponential  smoothing  is  based  on  the 
recursive  relationship 

Zt  = xZt-l  + (i-*)1 2 3!’  0<x<1  (2.50) 

where  Z are  mutually  independent  variables  with  mean  zero 
2 

and  variance  a . We  may  apply  (2.50)  to  each  component  of 
Z'  to  obtain  an  autocorrelated  vector  time  series.  Thus,  the 
procedure  is  as  follows: 

1.  Compute  the  C matrix. 

2.  Generate  p independent  variates  from  N(0,1)  and 
designate  ZQ. 

s t 

3.  Apply  (2.48)  to  the  above  to  get  the  1 vector. 
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4.  Generate  P independent  variates  from  N(0,1)  and 
designate  Zt>  t = 1,  2,  .... 

5.  Apply  (2.50)  to  each  component  of  and  Z^ to 
get  the  t*"^1  observation,  Z^. 

6.  Repeat  steps  2-5  until  the  desired  number  of 
observations  have  been  generated. 

When  sufficient  information  is  available  to  estimate 
all  necessary  information  to  fully  describe  the  time  series 
a different  approach  may  be  used.  We  have  shown  that  a 
multivariate  time  series  is  adequately  described  by 
C(x)  (2.43).  It  is  possible  to  construct  a correlation  matrix 
to  fully  describe  the  first  k observations  of  a discrete 
multivariate  time  series  as  follows: 


(2.51) 


P 

1 

2 ... 

P iii 

1 

2 ... 

P 

p 

t 

0 

0 . . . 

0 . . . 

k 

k ... 

k 

1 

0 

1 

P 1 2 ( 0)  ... 

Plp(°)  * * * 

pn(k) 

p12 (k)  ••• 

Plp(k) 

2 

0 

1 . . . 

P2P (0)  . . . 

p2iUO 

P22(k)  • •• 

p2p(k) 

• 

# 

• 

• 

1 ... 

pPi(k) 

pp2  • • • 

Ppp(k) 

P 

0 

1 

k 

• 

l 

P12(0) 

plp(0) 

2 

k 

1 

p2p(0) 

i i - — 


32 


where  t is  the  time  index,  p is  the  component,  and  (t) 

tli  t h 

is  the  correlation  of  the  1 and  j component  at  lag  x. 
The  k observations  from  the  multivariate  time  series  may 
then  be  generated  as  follows: 

1.  Compute  the  matrix  C such  that  C C'  = I where 
Z is  given  by  (2 . 51)  . 

2.  Generate  kp  independent  variates  from  N(0,1). 

3.  Apply  (2.48)  and  separate  the  components  to  form 
the  multivariate  time  series. 

These  two  procedures  will  be  of  great  utility  in  studying 
the  effects  of  a multivariate  time  series  on  the  MANOVA 
power  function. 
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CHAPTER  III 


MANOVA  POWER  GENERATION 


Introduction 

To  perform  a meaningful  analysis,  we  require  a 
procedure  which  will  enable  us  to  obtain  the  power  of  the 
MANOVA  test  in  a form  useful  to  us  in  operational  testing. 
Previous  research  has  addressed  this  problem  and  only  those 
points  necessary  for  an  adequate  development  will  be  reviewed. 
If  further  information  is  desired  an  excellent  development  is 
presented  in  [16] . 


MANOVA  Power  Criteria 

Under  the  usual  MANOVA  assumptions  we  would  be 
interested  in  determining  the  power  of  the  test, 

P {Reject  Ho  | Ho  is  false)  , (3.1) 

in  terms  of  the  hypothesis  we  are  testing.  As  in  the  case  of 
the  ANOVA  (2.8),  the  MANOVA  power  function  appears  to  be 
directly  related  to  the  departures  you  desire  to  detect. 

Three  useful  forms  of  the  departures  have  been  proposed  [16]. 

The  departures  may  be  specified  in  either  euclidean 
norm,  supremum  norm,  or  individual  component  departures. 

Thus,  the  euclidean  norm  is 
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— — (3.2) 


a (a^)  a (ah  a (a?) 

D9  = I — = — , I — i , E — 

2 i=l  all  i=l  a22  i=l  CTpp 


where  a|  is  the  departure  of  the  it^1  level  of  factor  A on 
component  j . The  Supremum  norm  is 


a (ah2 

D = max  E 

s • • , a . . 

1 i=l  jj 


j = 1,  2,  ....  p (3.3) 


If  individual  component  departures  are  to  be  specified  we 


would  desire  to  detect 


a (a{)2 

D.  = E — - — 
j * , a . . 

J i=i  n 


(3.4) 


where  the  other  p-1  component  departures  are  set  at  levels 
from  the  distribution  uniform  (0,  D^/R)  where  R = 1>  2,  .... 
to  be  selected. 


Monte  Carlo  Power  Generation 


A Monte  Carlo  approach  to  determining  the  power  of  the 
MANOVA  appears  appropriate  and  necessary  since  the  MANOVA 
power  function  is  not  available  in  a usable  form.  Our 
general  approach  will  be  to  generate  random  observations 
which  satisfy  the  MANOVA  model,  the  multivariate  time  series, 
and  the  size  and  type  component  departures  we  desire  to 
detect.  Once  we  generate  the  observations,  we  compute  the 
MANOVA  test  to  determine  whether  to  reject  the  null  hypothesis 


¥ 
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v 
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and  record  the  results.  We  repeat  this  procedure  a large 
number  of  times  and  the  power  of  the  test  is  the  ratio  of 
the  number  of  times  we  rejected  the  null  hypothesis  to  the 
total  number  of  tests  conducted. 

In  addition  to  the  usual  MANOVA  calculations,  with 
sample  size  n,  and  component  departures  we  desire  to  detect, 
we  must  be  able  to  accomplish  the  following: 

1.  Randomly  assign  the  p component  departures  in 
such  a manner  that  they  satisfy  the  MANOVA  power 
criteria  we  desire  to  use. 

2.  For  each  j = 1,  ...,  p randomly  assign  the  a 

components,  a?  , for  each  such  that 

a (ah2  a . 

E = D . and  E a-;.  = 0 . 

i-l  °jj  3 i-1  1 

3.  Obtain  an  estimate  of  the  response  correlation 
structure  in  the  form  of  a pxp  correlation  matrix. 

4.  Generate  a p-dimensional  multivariate  time  series 
of  error  vectors. 

Procedures  to  accomplish  items  1 through  3 are  covered  in 
detail  by  Burnette  [16].  Item  4 has  been  previously 
discussed  in  Chapter  II. 

MANOVA  Power  Generation  Procedure 

In  order  to  simplify  our  computations,  we  will  use 


1 

i 


a standardization  transformation  on  all  responses.  This 
transformation  is: 
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. - 11 
rj  = yJ V 


(0^) 


177 


(3.5) 


For  original  y distributed  N(p,E),  the  transformed  y'  will 
be  distributed  N(<j>,P),  where  P is  the  population  correlation 
matrix.  It  should  be  noted  at  this  point  that  the  MANOVA 
test  procedure  requires  the  population  correlation  matrix 
and  must  be  estimated  from  the  transformed  observations. 

The  observations  will  be  generated  such  that  they  compose  a 
multivariate  time  series.  This  transformation  will  greatly 
simplify  the  MANOVA  power  calculations  and  permit  us  to 
express  the  component  departures  in  standardized  units  of 
component  variances  of  1. 

The  procedure  we  will  use  to  determine  the  power  of 
the  MANOVA  test  for  a given  probability  of  type  I error,  a, 
sample  size,  n,  is  as  follows: 

1.  Select  the  MANOVA  model,  for  example,  a completely 
crossed,  two  factor,  p-dimensional  MANOVA  model. 

2.  Estimate  the  multivariate  time  series  parameters. 

3.  Select  the  hypothesis  to  be  tested,  for  example, 
no  effect  due  to  factor  A. 

4.  Select  the  size  and  type  component  departures  we 
desire  to  detect. 

5.  Select  the  number  of  Monte  Carlo  iterations,  NR, 
we  desire  to  run. 


I 


6.  For  each  Monte  Carlo  iteration,  randomly  assign 
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7. 


8. 


9. 

10. 


the  component  departures  and  component  departure 
levels,  as  appropriate. 

For  each  model  index  combination,  for  example, 
the  two-factor  MANOVA  model  above,  generate  an 
error  vector  e...  from  the  multivariate  time 

-1 J K 

series  and  apply  the  model  with  all  effects 
levels  zero  except  the  effect  being  tested. 

Compute  the  MANOVA  test  statistic,  compare  it  with 
the  critical  value  of  the  test,  and  record  the 
results . 

Repeat  steps  5-8  NR-1  times. 

Compute  the  power  of  the  MANOVA  test: 


power 


number  of  hypothesis  rejected 



Previous  experience  has  shown  that  NR  500  is  adequate  and 
will  be  used  unless  otherwise  specified. 

A complete  FORTRAN  IV  program  with  necessary 
subroutines  for  use  on  the  CDC  CYBER  74  appears  in  Appendix  A. 
The  program  is  a conversion  of  the  program  developed  and 
validated  by  Burnette  for  use  on  the  UNIVAC  1108  [16] . The 
program  has  been  modified  to  generate  autocorrelated  error 
vectors  based  on  a subjective  estimate  of  the  autocorrelation 
structure.  The  program  may  be  easily  modified  to  generate 
error  vectors  when  there  is  sufficient  information  to 


totally 

describe  the  multivariate  time  series. 
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CHAPTER  IV 

INVESTIGATION  OF  THE  EFFECTS  OF  A MULTIVARIATE 
TIME  SERIES  ON  THE  MANOVA  POWER  FUNCTION 

Introduction 

We  turn  our  attention  now  to  a primary  objective  of 
this  research;  that  is,  investigating  the  effects  of  a multi- 
variate time  series  on  the  MANOVA  power  function.  In 
Chapters  II  and  III  we  developed  the  procedures  necessary  to 
determine  the  power  of  the  MANOVA  test  criteria  for  a given 
set  of  parameters.  We  have  previously  noted  that  the  MANOVA 
power  function  is  also  dependent  upon  a number  of  other 
factors  and  any  investigation  would  not  be  complete  without 
simultaneously  considering  all  parameters  which  affect  the 
MANOVA  power  function. 

Those  factors  which  have  been  found  are  listed  below 
for  easy  reference.  They  are: 

1.  Power  is  a decreasing  function  of  the  dimension 
of  the  multiresponse. 

2.  Power  is  an  increasing  function  of  the  size 
departure  from  the  null  hypothesis. 

3.  Power  is  an  increasing  function  of  sample  size. 

4.  Power  is  an  increasing  function  of  the  probability 
of  Type  I error. 
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5.  Power  is  an  increasing  function  of  -log  |P  | , 
where  P is  the  correlation  matrix  of  the  multiresponse. 

We  desire  to  construct  an  experiment  which  will  enable  us 
to  simultaneously  consider  all  factors  which  affect  the 
MANOVA  power  function. 

Analysis  of  Effects 

It  was  decided  that  an  appropriate  method  to  simul- 
taneously investigate  the  effects  would  be  to  use  a 

factorial  design  and  analyze  the  results  by  ANOVA.  Prior 

lc 

to  selecting  the  design,  either  a 2 or  a 3',  it  was 
necessary  to  determine  if  the  main  effects  were  linear  or 
of  some  higher  order.  Thus,  six  individual  experiments  were 
conducted  to  determine  the  nature  of  the  main  effects . In 
each  experiment  the  effect  under  investigation  was  varied 
over  the  range  of  interest  while  the  other  effects  were  held 
constant.  In  each  case  there  appears  to  be  a linear  trend 
in  the  main  effect,  with  the  exception  of  the  response 
dimension,  and  thus,  it  was  felt  that  a 2 experimental 
design  would  be  appropriate. 

The  effect  of  the  dimension  of  the  response  was 
investigated  by  the  procedure  described  above.  We  found  that 
the  dimension  of  the  response  could  not  be  separated  from 
the  other  factors  and  thus  could  not  be  included  as  a factor. 
It  was  then  decided  to  run  two  full  2^  factorial  experiments 
with  the  dimension  of  the  response,  p,  set  at  2 in  the  first 
and  3 in  the  second.  By  this  procedure  we  hoped  to  be  able 
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b 


to  determine  visually  if  the  power  of  the  MANOVA  did  decrease 
with  tiie  dimension  of  the  response. 

The  experimental  design  is  shorn  in  Tables  1 and 

2 with  the  high  and  low  levels  of  each  factor  in  each 
experiment.  The  eculidean  norm  was  specified  in  the  MANO'A 
power  generator  and  was  adjusted  so  that  the  norm  for  P = 2 
and  P = 3 were  of  the  same  relative  magnitude. 

The  experiments  were  run  on  the  CDC  Cyber  74  and 
the  complete  ANOVA  for  each  are  in  Tables  3 and  4.  The 
experiment  was  not  replicated  since  the  number  of  replications 
of  the  MANOVA  power  generator,  NR  = 500,  results  in  little 
or  no  variation  in  the  responses.  The  effects  in  each 
experiment  were  plotted  on  normal  probability  paper,  Figures 
1 and  2,  in  accordance  with  the  procedure  outlined  by 
Montgomery  in  [43].  If  the  fourth  and  fifth  oruer  inter- 
actions fall  along  that  portion  of  the  plot  where  the  effects 
may  be  represented  by  a straight  line  then  ANOVA  is  appropriate 
In  both  experiments  this  requirement  is  met  and  the  error 
sums  of  squares  is  estimated  using  the  fourth  and  fifth  order 
interactions.  The  results  of  the  ANOVA  are  given  in  Tables 

3 and  4 . 

The  analysis  of  both  experimental  designs  verify  that 
all  main  effects  are  highly  significant.  We  also  note  that 
the  results  also  indicate  a number  of  second-order  inter- 
actions are  significant  while  no  third-order  interactions  are 
significant.  However,  if  we  examine  the  percentage  of  total 
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Table 

1.  Experimental 

Design  #1 

Factor 

Level 

Response 

Dimension 

Sample 

Size 

Departure 

to 

detect 

Probability 
of  Type 

I Error 

Auto- 

correlation 

Coefficient 

Value 

of 

|P| 

P 

n 

D2 

a 

X 

|P| 

Low 

2 

4 

. 5 

.05 

.2 

.4 

High 

2 

6 

1.0 

.10 

.5 

.8 

I # 


Table  2.  Experimental  Design  #2 


I ? 


Factor  Response  Sample  DeParture  Probability  Auto-  Value 

to  of  Type  Correlation  of 

Detect  I Error  Coefficient  I P I 


Level  Dimension  Size 


n 


D. 


jWfjv' 


* Table  3.  Complete  ANOVA  for  Experiment  1 


E ■ 

: 

i 

Source 

df 

SS 

MS 

F 

0 

f ?*• 

Probability  of  Type  I 

1 

202  . 5 

202.5 

14.25* 

| ** 

error,  a 

Autocorrelation  Coefficient, 

X 

1 

1,430.4 

1,430.4 

100.63* 

a x X 

1 

4.1 

4.1 

0.29 

Norm  to  Detect, 

1 

1,926.5 

1,926.5 

135.54* 

a x 

1 

45.8 

45.8 

3.22 

X x 

1 

234.3 

234.3 

16.48* 

a x X x D2 

1 

3.1 

3.1 

0.22 

Sample  Size,  n 

1 

746.5 

746.5 

52.52* 

a x n 

1 

6.1 

6.1 

0.43 

I . 

X x n 

1 

153.7 

153.7 

** 

10.81 

a x X x n 

1 

5.8 

5.8 

0.41 

D2  x n 

1 

118.3 

118.3 

** 

8.33 

a x D2  x n 

1 

. 2 

.2 

0.01 

X x D2  x n 

1 

31.0 

31.0 

2.18 

The  value  of  the  Determinant, 

|P| 

1 

2,268.0 

2,268.0 

159.56* 

ax  | P | 

1 

52.9 

52.9 

3.72 

X x |P| 

1 

287.2 

287.2 

20.21* 

a x X x |P| 

1 

20.7 

20.7 

1.46 

K.  - 

&'■ 
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Table  3 (concluded) 

¥ 

Source 

df 

SS 

MS 

Fo 

i\v 

1 v 

D,  x | P | 

1 

246.0 

246.0 

17.31* 

u:  ft, 

| 7- 

a x T>2  x | P | 

1 

5.5 

5.5 

0.39 

\ b 

E ’#■ 

X x D£  x | P | 

1 

18.0 

18.0 

1.26 

I V 

n x | P | 

1 

92.4 

92.4 

6.50 

B jp^-. 

a x N x | P | 

1 

3.8 

3.8 

0.27 

% 

X x n x | P | 

1 

52.0 

52.0 

3.66 

D2  x n x | P | 

1 

3.6 

3.6 

0.25 

Error 

6 

85.3 

14.2 

** 


Indicates  significance  at  the  1-percent  level. 
Indicates  significance  at  the  5-percent  level. 
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Table  4.  Complete  ANOVA  for  Experiment  2 


Source 

df 

SS 

MS 

Fo 

a 

1 

948.7 

948.7 

209.20* 

X 

1 

4,554.0 

4,554.0 

1,004.25* 

a x X 

1 

147.5 

147.5 

32.52* 

D2 

1 

2,842.6 

2,842.6 

626.85* 

a x D2 

1 

114.2 

114.2 

25.19* 

X x D2 

1 

544.6 

544.6 

120.11* 

a x X x D2 

1 

23.1 

23.1 

5.10 

n 

1 

1,331.7 

1,331.7 

293.67* 

a x n 

1 

72.9 

72.9 

16.08* 

X x n 

1 

427.7 

427.7 

94.30* 

a x X x n 

1 

10.0 

10.0 

2.21 

D2  x n 

1 

91.2 

91.2 

20.11* 

a x D2  x n 

1 

16.9 

16.9 

3.73 

X x D2  x n 

1 

14.9 

14.9 

3.28 

|P| 

1 

1,811.7 

1,811.7 

399.52* 

ax  | P | 

1 

13.9 

13.9 

3.07 

X x |P| 

1 

348.1 

348.1 

78.76* 

a x X x | P | 

1 

2.7 

2.7 

0.60 

Dy  X | P | 

1 

128.2 

128.2 

28.26* 

I 


Figure  1 


Plot  of  the  Effects  for  the  First 
Experimental  Design  on  Normal 
Probability  Paper 
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Figure  2 


Plot  of  the  Effects  for  the  Second 
Experimental  Design  on  Normal 
Probability  Paper 


ii 
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variation  explained  by  the  main  effects,  their  mean  square, 
and  the  amount  of  total  variation  explained  by  the  second 
order  interactions  we  may  infer  that  some  of  the  second 
order  interactions  are  not  significant.  The  Ax  |P|, 

D2  x | P | , A x D2  and  the  A x n interactions  appear  signifi- 
cant in  this  perspective. 

Additional  information  on  the  second-order  inter- 
actions can  be  acquired  through  their  graphical  represen- 
tation. The  interaction  of  the  autocorrelation  coefficient 

I 

with  the  other  factors  is  graphically  displayed  in  Figures 
3 and  4 for  Experiments  1 and  2,  respectively.  The  graphical 
results  again  confirm  the  interaction  of  the  autocorrelation 
coefficient  with  the  other  factors  and  also  indicates  that 
the  autocorrelation  coefficient  has  its  greatest  effect  on 
the  other  factors  when  they  are  at  their  low  levels.  This 
result  is  not  surprising  since  we  would  expect  the  greatest 
increase  in  the  MANOVA  power  to  occur  when  the  MANOVA  power 
is  low;  that  is,  when  the  other  factors  are  at  their  low 
levels . 

We  may  now  make  several  general  statements  concerning 
the  factors  which  influence  the  MANOVA  power  function.  They 
are : 

1.  All  five  factors  considered  in  the  experimental 
design  significantly  affect  the  MANOVA  power  function. 


2.  The  numerous  second-order  interactions  make  an 
interpretation  of  the  effects  of  the  factors  on  the  MANOVA 
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Figure  3.  Graphical  Results  of  Experiment  1 
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Figure  4.  Graphical  Results  of  Experiment  2 
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power  function  extremely  difficult. 

3.  The  autocorrelation  coefficient,  A,  the  determi- 
nant of  the  correlation  matrix,  |P|,  and  the  departure, 
appear  to  have  a very  significant  effect  on  the  MANOVA 
power  function  through  second-order  interactions. 

4.  The  power  of  the  MANOVA  test  statistic  decreases 
with  the  dimension  of  the  response. 

5.  The  autocorrelation  coefficient.  A.,  has  a greater 
effect  on  the  MANOVA  power  function  when  the  other  factors 
are  at  their  low  levels. 

Conclus ions 

The  above  analysis  of  the  experimental  data  leads  us 
to  the  conclusion  that  all  five  factors  do  in  fact  influence 
the  MANOVA  power  function.  That  is: 

1.  Power  is  a decreasing  function  of  the  dimension 
of  the  response. 

2.  Power  is  an  increasing  function  of  the  size 
departure  from  the  null  hypothesis. 

3.  Power  is  an  increasing  function  of  sample  size. 

4.  Power  is  an  increasing  function  of  the  probability 
of  Type  I error. 

5.  Power  is  an  increasing  function  of  -Log  |P|. 

We  also  note  that  power  is  an  increasing  function  of 
the  autocorrelation  structure  of  the  response  vector.  That 
is,  power  increases  as  the  significance  of  the  multivariate 
time  series  increases. 
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It  is  also  noted  that  the  large  number  of  significant 
second -order  interactions  make  an  interpretation  of  the 
response  difficult;  however,  we  may  note  that  1,  2,  4,  and 
the  autocorrelation  account  for  a significant  portion  of 
the  interaction  sum  of  squares.  Thus,  if  subjective 
estimates  are  to  be  made  for  either  X or  P great  care  must 
be  exercised  due  to  their  impact  on  the  MANOVA  power  function. 


JT‘ 


t,;T 


.¥■ 


CHAPTER  V 

A METHODOLOGY  FOR  COMPARING  ANOVA  WITH  MANOVA 

Introduction 

We  now  return  to  a primary  objective  of  this  research: 
to  develop  a methodology  for  comparing  the  effectiveness  of 
ANOVA  with  MANOVA  for  use  in  the  operational  test  and  evalu- 
ation  of  command  and  control  systems.  Clearly,  MANOVA  is  the 
preferred  procedure  for  evaluating  systems  with  correlated 
measures  of  effectiveness  since  it  provides  a joint  comparison 
of  the  measures. 

Burnette  has  developed  a methodology  for  comparing 
the  ANOVA  with  MANOVA  on  a basis  of  power  of  the  tests.  It 
was  noted  by  Burnette  that  the  powers  of  the  tests  appears 
to  be  the  only  method  for  comparing  the  ANOVA  and  the  MANOVA. 
Our  research  has  not  indicated  a more  appropriate  approach; 
therefore,  the  essential  elements  of  Burnette's  research  will 
be  reviewed. 

Segregating  the  Measures  of  Effectiveness 
Separation  of  Independent  Measures 

A comparison  of  the  effectiveness  of  ANOVA  with  MANOVA 
is  not  applicable  for  independent  measures  of  effectiveness. 
Our  first  task  should  be  to  separate  all  independent  measures 
from  the  rest.  We  may  separate  the  measures  of  effectiveness 
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by  an  application  of  (2.25)  and  (2.26).  For  a system  with 
p measures  of  effectiveness  we  would  compute  the  sample 
multiple  correlation  coefficients,  , i = 1,  ...,  p,  and 
test  the  p hypothesis  of  the  form 


For  those  hypothesis  which  we  fail  to  reject  we  assign  the 
measure  to  the  set  of  mutually  independent  measures,  I. 


Grouping  of  Independent  Sets  of  Measures 


After  separating  the  independent  measures  we  would 
like  to  group  the  remaining  measures  into  k sets  which  are 
correlated  within  sets,  but  independent  between  sets.  Let 
us  designate  the  sets  C^,  i - 1,  ...,  k.  This  grouping  may 
be  accomplished  using  the  procedure  of  (2.28)  and  (2.29). 

In  addition,  we  may  test  to  insure  that  each  set  is 
correlated  using  the  procedure  of  (2.27). 

For  those  k independent  sets  of  correlated  measures, 
C^,  i = 1,  ...,  k,  MANOVA  is  the  appropriate  procedure  to 
utilize.  For  those  measures  which  have  been  assigned  to  the 
set  of  independent  measures,  I,  only  ANOVA  is  appropriate. 


55 


Determining  the  Powers  of  the  Tests 

ANOVA  Power 

To  determine  the  ANOVA  power  the  following  must  be 
specified : 

1.  a,  the  probability  of  Type  I error. 

2.  n , the  maximum  sample  size  permitted. 

max’  r r 

a 2 2 

3.  I a- /a  = D the  component  departure  to  detect. 
i=l  1 

4.  (1-8),  the  power  of  the  test  desired. 

Based  on  the  above  information  the  sample  size  required  to 

achieve  the  desired  ANOVA  power,  n „ is  determined.  If 

r * anova 

the  desired  power  can  not  be  achieved  by  a sample  size  n 
then  either  the  maximum  sample  size  or  the  departure,  or 
both,  must  be  reconciled.  The  above  procedure  is  performed 
for  each  measure  of  effectiveness . 

MANOVA  Power 

In  addition  to  the  parameters  provided  for  each 
individual  measure  of  effectiveness,  for  each  independent 
set  of  correlated  measures,  C-,  i = 1,  ...,  k,  the  following 
must  be  specified. 

1.  a,  the  joint  probability  of  Type  I error. 

2.  (1-8),  the  joint  power  desired. 

3.  R,  the  ratio  of  the  primary  component  departure 
to  the  maximum  departure  of  the  other  components. 

The  maximum  sample  sizes  as  well  as  the  departures  to  detect 
would  have  previously  been  specified. 


uif  .WMPiPrT”) 


For  a correlated  set  of  measures,  , i = 1,  ...»  k, 

we  are  constrained  by  the  minimum  sample  size  in  the  set, 

n . = min(n  _ . ) , so  far  as  MANOVA  sample  size  is 

mxn  v anova  j J r 

concerned  with  the  system  as  a whole.  If  we  are  unable  to 
achieve  the  desired  MANOVA  power  for  each  of  the  p^  measures 
in  the  set  using  n . , then  to  increase  the  power,  measures 
may  be  deleted  from  the  set  p^  to  increase  the  power.  These 
measures  will  be  deleted  as  follows: 


. 


J 

I 


I 
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1.  The  measure  corresponding  to  n - will  be 

r min 

deleted  first. 

2.  If  two  measures  correspond  to  n • then  the 

r min 

measure  with  the  smallest  power  will  be  deleted. 

3.  If  there  are  only  two  measures  in  the  set  both 
will  be  deleted. 

Those  measures  deleted  will  be  assigned  to  the  set  I for 
which  ANOVA  is  more  effective  than  MANOVA. 

Summary  of  the  Methodology 
A summary  of  the  methodology  for  comparing  the 
effectiveness  of  the  ANOVA  with  MANOVA  is  as  follows: 

1.  Determine  the  correlation  matrix  for  the  measures 
of  effectiveness. 

2.  Separate  the  measures  into  mutually  independent 
measures,  I,  and  correlated  measures,  C^, 

i = 1 , . . . , k. 

3.  Determine  the  probability  of  Type  I error,  a, 
and  the  power  of  the  test,  (1-6),  to  be  utilized. 

4.  For  each  measure  determine  the  maximum  sample 

size  permitted,  n , and  the  univariate  departure 
r max ’ r 

to  detect. 

5.  For  each  measure  of  effectiveness  determine  the 
sample  size,  nanova>  t0  achieve  the  required  power. 

6.  For  each  set  of  correlated  measures  of  effective- 
ness, C^,  i = 1,  ...»  k,  perform  the  following. 


MM. 


■ — - 


1 


1 


< 


mm 
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(a)  For  each  measure  of  effectiveness,  Y-*  , j = 1 , 

p.,  determine  the  sample  size,  n . required  to 

achieve  the  desired  MANOVA  power. 

(b)  If  the  n „ are  less  than  or  equal  to 

J manova  n 

n . = min  (n  •)  for  the  desired  power,  stop:  MANOVA  is 

nun  j v anova  j r r 

more  effective  than  ANOVA  for  the  measures  in  the  set. 

(c)  If  the  n „ are  greater  than  n . for  one  or 

more  measures  in  the  set,  remove  from  the  set  the  measure 

corresponding  to  If  more  than  one  measure  corresponds 

to  n . , remove  from  the  set  the  measure  with  the  lowest 
min 

power  which  corresponds  to  n . . Renumber  the  measures  in 
r mm 

the  set  which  remain;  set  p^  = If  P^  = 1*  stop;  ANOVA 

is  more  effective  than  MANOVA  for  all  original  measures  in 
the  set  (N  . If  p^  > 1,  repeat  steps  a through  c. 

The  methodology  will  be  demonstrated  in  Chapter  VI . 
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CHAPTER  VI 

AN  APPLICATION  TO  OPERATIONAL  TESTING 
Introduction 

In  this  chapter  we  shall  apply  the  methodology 
developed  in  Chapter  V to  an  operational  testing  problem. 

IVe  will  use  the  hypothetical  command  and  control  system 
used  by  Burnette  so  that  the  results  may  be  compared.  The 
hypothetical  command  and  control  system  will  be  known  as  the 
Brigade  Antiarmor  Command  and  Control  System  (BACCS) . Two 
competing  forms  of  BACCS  are  under  consideration  for 
acquisition  and  are  designated  BACCS-I  and  BACCS-II. 

For  OT-II,  the  commander,  U.  S.  Army  Operational  Test 
and  Evaluation  Agency  (OTEA) , has  approved  a comparative 
operational  test  of  the  two  systems  consisting  of  three 
scenarios.  The  commander  has  also  approved  seven  measures 
of  effectiveness  designated  MOE-1  through  MOE-7.  In 
addition,  the  commander  has  approved  a completely  crossed 
two-factor  experiment  with  equal  numbers  of  observations  per 
cell.  He  desires  to  determine  for  which  MOE  MANOVA  will  be 
most  effective,  powerwise,  than  ANOVA. 

Correlation  Structure  of  the  MOE 

An  objective  estimate  of  t correlation  structure  of 


the  MOE  correlation  matrix  is: 


OT-1  test  results  indicated  that  each  response  vector  was 
related  to  the  previous  response  vector.  However,  insufficient 
information  was  available  to  obtain  an  objective  estimate; 
therefore,  a subjective  estimate  of  the  autocorrelation 
coefficient,  X = 0.3,  was  made  by  the  BACCS  project  manager 
and  the  U.  S.  Army  Training  and  Doctrine  Command. 

Based  upon  a knowledge  of  BACCS,  we  feel  that  MOE-1  is 
independent  of  all  other  MOE . We  test  the  hypothesis 


against 


H 


1 


Pj_  t 0 


Using  a computer  program  (Appendix  B)  we  compute  the  sample 
multiple  correlation  coefficient 


Rx  = 0.293452 


= 0.86114 


applying  (2.26)  we  obtain  the  test  statistic 


n R1  (n'P)  ( . 086114)  (42-7)  0 

Q iTr^p^)"  rr~omr47lTTj-  °-5515 


We  desire  to  test  the  hypothesis  at  a = 0.05  and  determine 
the  critical  value  of  the  test  is  F q5  6 35  = ^-36.  The 
test  statistic  is  less  than  the  critical  value  of  the  test; 
hence,  we  fail  to  reject  the  hypothesis  that  MOE  1 is  inde- 
pendent of  the  other  MOE.  MOE-1  is  assigned  to  the  set  of 
mutually  independent  measures,  I. 

Our  knowledge  of  BACCS  indicates  that  MOE- 2 and  MOE- 7 
are  correlated,  but  independent  of  the  other  MOE.  We  also 
feel  that  MOE-3,  MOE-4,  MOE-5,  and  MOE-6  are  correlated  but 
independent  of  the  other  MOE.  We  assign  MOE-2  and  MOE-7  to 
correlated  set  C^.  We  assign  MOE-3,  MOE-4,  MOE-5,  and  MOE-6 
to  correlated  set  C2.  The  correlation  matrix  for  the  set 
is  now  the  2x2  matrix 


and 


7 


.76 


1.0 


I 
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and  the 
matrix 


correlation  matrix  for  set  is  now  the  4x4 


3 

1.0 

ON 

GO 

- .49 

. 56 

4 

. 68 

1.0 

- .21 

.72 

5 

- .49 

- .21 

1.0 

- .26 

6 

. 56 

.72 

- .26 

1.0 

We  desire  to  test  the  hypothesis  that  set  and  set 
C0  are  mutually  independent  using  the  procedures  of  (2.28) 
and  (2.29)  with  a = 0.05.  Using  a computer  program 
(Appendix  C) , we  determine  the  test  statistic 


I 


Xq  = 4.1630 

and  the  critical  value  of  the  test 

X2.05,8  ' 15-5072 

The  test  statistic  is  less  than  the  critical  value  of  the 
test;  hence,  we  fail  to  reject  the  hypothesis  of  independence 
and  conclude  that  and  C.,  are  independent.  We  must  now 
check  to  determine  if  the  MOE  within  the  mutually  independent 
sets  and  are  independent. 

We  observe  that  set  C-^  has  only  two  HOE  and  thus  has 
a bivariate  normal  distribution.  We  may  then  ma^e  use  of  the 


4 


v"'  :.*-*&*:*'  r;- 
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Fisher  Z-transformation  and  test  the  hypothesis 

H10  ''  p27  * 0 

against 

H11  : p27  * °* 

Using  (2.19)  through  (2.22)  we  find 

z = tanh  1 (.76)  = 0.638 

and  the  test  statistic  is 

| Z | /m  = 0.638  JVTZ  = 3.984. 

The  critical  value  of  the  test  with  a = .05  is  Z ^ = 1.96. 
The  test  statistic  exceeds  the  critical  value  of  the  test; 
hence,  we  reject  H^g  and  conclude  MOE-2  and  MOE-7  are 
correlated. 

We  test  the  following  hypothesis 


against 
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H21  : ?c2  * 1 


to  determine  if  MOE-3,  MOE-4,  MOE-5,  and  MOE-6  are  correlated, 
Using  the  results  of  (2.27)  and  a computer  program  (Appendix 
D)  we  determine  the  test  statistic 


V 


y2  = 
X0 


(N-l  - 


2k+5.  , 

— g-)  Log 


R 


- (42-1  - 


Log  |R| 


65.81137. 


With  a = .05  the  critical  value  of  the  test  is 


.05,6  = 12-59120. 


The  test  statistic  exceeds  the  critical  value  of  the  test; 
hence,  we  conclude  the  members  of  C2  are  correlated. 

The  above  tests  have  enabled  us  to  separate  the  MOE 
into  three  mutually  independent  sets: 


I = MOE- 1 
C1  = MOE- 2,  MOE- 7 
C2  = MOE-3,  MOE-4,  MOE-5,  MOE-6. 

ANOVA  is  appropriate  for  MOE-1,  the  sole  member  offset  I; 
therefore,  MOE-1  will  not  be  used  for  a comparison  of  the 
effectiveness  of  MANOVA  with  ANOVA. 
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ANOVA  Power/Sample  Size  for  the  MOE 

The  Commander  of  OTEA  has  specified  the  following 
probability  levels  be  used  for  BACCS  OT-II: 

Probability  of  Type  I error,  -.05 
Power  of  the  test  (1-0)  -.75. 

These  parameters  will  apply  to  both  ANOVA  and  MANOVA.  In 
addition,  the  maximum  sample  size,  nmax,  and  the  departure 
to  be  detected,  D,  have  been  specified  for  each  MOE.  These 
parameters  are  shown  in  Table  5. 


Table  5.  MOE  Maximum  Sample  Sizes  and  Departures 


MOE 


Maximum 
S amp 1 e Size 


Departure 
to  Detect 


nmax 


D 


1 6 1.5 

2 6 1.5 

3 4 2.0 

4 6 1.5 

5 6 1.5 

6 7 1.0 


7 


6 


1.5 
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Using  the  information  in  Table  5 we  compute  for  each 

MOE  the  minimum  sample  size,  n , required  to  achieve  the 

r * anova ’ n 

desired  power.  We  accomplish  this  by  using  the  results 
reviewed  in  Chapter  II.  The  results  are  shown  in  Table  6. 


Table  6.  MOE  Sample  Sizes  for  Required  Power 


MOE 

Maximum 
Sample  Size 

Departure 
to  Detect 

Minimum 
Sample  Size 

nmax 

D 

nanova 

1 

6 

1.5 

5 

2 

6 

1.5 

5 

3 

4 

2.0 

4 

4 

6 

1.5 

5 

5 

6 

1.5 

5 

6 

7 

1.0 

7 

7 

6 

1.5 

5 

Comparing  the  Effectiveness  of  MANOVA  with 

ANOVA 

For 

the  two  sets  of  correlated  measures. 

C^  and  C2, 

we  are  now 

interested  in 

determining  for  which 

members  of 

these  sets 

MANOVA  is  more 

effective  than  ANOVA 

from  the 

standpoint 

of  power.  The 

Commander  of  OTEA  has 

approved 

a ratio  R = 

= 2 for  use  in 

setting  the  random  levels  of  the 

MOE  in  the 

sets  other  than  those  under  consideration. 

For 

set  C^  = {MOE- 

2,  MOE-7}  we  find  that 

nmin 
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min  {n  - , n -,}  = 5 (Table  5).  Using  the  two- 

factor  MANOVA  program  (Appendix  A) , we  set  levels  of  factor 

A = 2,  levels  of  factor  B = 3,  D = 1.5,  sample  size  = 

n . = 5,  X = .3,  R = 2,  Monte  Carlo  iterations  = 500,  and 

correlation  matrix  P . The  results  are  tabulated  in 

~C1 

Table  7 with  the  results  of  Burnette's  research  for  ease  of 
comparison. 


Table  7.  MOE  Power  1 


MANOVA 

Departure 

Power 

Power 

MOE 

Sample  Size 

to  Detect 

Achieved  by 

Achieved  by 

Vanova 

D 

Burnette 

this  Research 

2 

5 

1.5 

.762 

.866 

7 

5 

1.5 

. 824 

1.000 

The  MANOVA  power  is  greater  than  the  ANOVA  power  with 
sample  size  n • ; thus,  MANOVA  is  more  effective  than  ANOVA 
for  members  of  set  C^. 

For  set  C2  = {MOE-3,  MOE-4,  MOE-5,  MOE-6}  we  use  the 

same  two  factor  MANOVA  power  program.  We  set  a = .05, 

levels  of  factor  A = 2,  levels  of  factor  B = 3,  Monte  Carlo 

iterations  = 500,  X = .3,  and  R = 2.  For  the  four  MOE 

n • = 4 = n , . We  run  the  power  program  for  each  MOE 

min  anova  3 

with  sample  size  n . =4  and  departures  to  detect,  D = D. , 

r mm  r j 


j = 3,  4,  5,  6.  The  results  are  shown  in  Table  8 for  this 
research  and  Burnette's  for  ease  of  comparison  of  results. 


Table  8.  MOE  MANOVA  Power  2 


* V 

i 

MANOVA 

Departure 

Power 

Power 

s 

MOE 

Sample  Size 

to  Detect 

Achieved  by 

Achieved  by 

V 

nmanova 

D 

Burnette 

this  Research 

¥ 1 

*■ 

ji 

3 

4 

2.0 

.614 

.850 

A 

L” 

4 

4 

1.5 

.482 

.824 

5 

4 

1.5 

.496 

.776 

6 

4 

1.0 

.452 

.994 

We  note  that 

again  the  MANOVA  power  exceeds  the  power 

of  the 

ANOVA  for  all 

components , 

therefore,  we 

conclude  that 

MANOVA 

is  more  effective  than  ANOVA  for  all  members  of  the 

set  C2* 

In  summary 

we  have  found 

that  MANOVA 

is  superior 

* 

to  ANOVA  for  both  sets  = {MOE- 

2,  MOE- 7}  and 

set 

C2  = {MOE -3 , MOE- 4 , MOE-5,  MOE-6}.  This  information  would 
be  used  in  to  aid  in  the  design  of  BRACCS  OT-II. 

Although  the  example  presented  in  this  chapter  is 
hypothetical  the  methodology  as  demonstrated  here  may  be 
applied  to  any  system  so  long  as  an  estimate  of  the  structure 
of  the  response  is  available.  We  also  note  that  the 
introduction  of  autocorrelated  vectors  greatly  influence  the 
MANOVA  power  function.  Burnette  was  able  to  achieve  joint 


inference  on  only  two  MOE  in  set  C2  [16]  at  the  specified 
power.  Our  analysis,  using  the  systems  information,  has 
enabled  us  to  achieve  joint  inference  on  all  four  MOE  of 
set  C2  at  the  specified  power  level  greatly  enhancing  the 
analysis  of  the  test  results. 


f 
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CHAPTER  VII 

CONCLUSIONS  AND  RECOMMENDATIONS 

Limitations  of  the  Research 

This  research  has  been  limited  by  the  initial  assump- 
tions of  two-factor,  fixed-effects,  crossed  models,  equal 
sample  sizes  per  cell,  and  no  effects  due  to  operators.  In 
addition,  it  was  assumed  that  an  estimate  of  the  correlation 
structure  of  the  measure  of  effectiveness  and  the  auto- 
correlation coefficient  or  all  the  parameters  of  a multi- 
variate time  series  are  available. 

Conclusions 

This  research  has  accomplished  two  objectives: 
first,  through  the  use  of  two  experimental  designs  analyzed 
by  ANOVA  it  has  been  shown  that: 

1.  The  MANOVA  power  is  a decreasing  function  of  the 
dimension  of  the  response. 

2.  The  MANOVA  power  is  an  increasing  function  of  the 
size  of  departure  from  the  null  hypothesis. 

3.  The  MANOVA  power  is  an  increasing  function  of 
sample  size. 

4.  The  MANOVA  power  is  an  increasing  function  of 
the  probability  of  Type  I error. 

5.  The  "iANOVA  power  is  an  increasing  function  of 
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-Log  | P | , where  P is  the  correlation  matrix  of  the  multi- 
response. 

6.  The  MANOVA  power  is  an  increasing  function  of 
the  significance  of  the  time  dependence  of  the  response 
vectors . 

7.  An  extremely  complex  relationship  exists  between 
statements  2-5  since  most  second  order  interactions  were 
found  to  be  significant. 

Second,  it  was  found  that  the  incorporation  of  the 
time  series  into  the  MANOVA  power  function  significantly 
increased  the  MANOVA  power  for  a given  sample  size.  It  was 
also  noted  that  a reduction  in  sample  size,  for  a given 
power,  can  be  achieved  when  the  time  series  information  is 
incorporated  in  the  MANOVA  power  function. 

Recommendations 

Several  recommendations  for  further  research  arose 
during  the  course  of  this  research.  One  recommendation  is 
to  develop  an  exact  statistical  test  for  a multiresponse 
system  when  the  responses  are  time  dependent.  An  experiment 
could  then  be  designed  using  the  exact  test  and  the  current 
procedure  to  determine  if  MANOVA  is  robust  to  independence 
of  observations.  Another  recommendation  is  to  extend  the 
MANOVA  power  program  so  that  it  may  handle  nested,  multi- 
factor designs. 


*-r  ■>  . v . -> 
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I 

APPENDIX  A 

This  appendix  contains  a complete  FORTRAN  IV  listing 
of  the  two-factor  MANOVA  power  program  along  with  its  use. 

The  program  is  entirely  interactive  and  all  input  is  made 
in  free-field  format.  This  listing  is  a modification  and 
conversion  of  previous  work  [16] . 
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**  MAN0VA  P0VER  PR0GRAM  ** 

ENTER  THE  NR  0F  STARTUP  RUNS  F0R  UN IF 
1 89 

ENTER  THE  NR  0F  LEVELS  0F  FACT0R  A 

2 " 

ENTER  THE  NR  0F  LEVELS  0F  FACT0R  B 

3 

ENTER  THE  DIMENSI0N  0F  THE  RESP0NSE 
A 

I 

ENTER  THE  SAMPLE  SIZE 
A 

ENTER  ALPHA 
.05 

00  Y0U  DESIRE  T0  SPECIFY  ALL  N0RM  C0MP0NENTS7 

YES 

ENTER  THE  N0RM  INDEX  T0  BE  SPECIFIED 

1 

WHAT  N0RM  RATI0  D0  Y0U  WANT  T0  USE? 

2. 

ENTER  THE  SIZE  N0RM  Y0U  DESIRE  T0  DETECT 

2. 

ENTER  THE  I TERATI0NS  SAMPLE  SIZE 
500 


ENTER  THE  SIGMA  MATRIX 
1 . # » 68# - • A9# .56 
•68# 1 .#-.21# .72 
— » A9  # — .21# 1 .#  — .26 
•56# .72#— .26# 1 . 


ENTER  THE  MEAN  VECT0R 

o.#o«#o.#o. 

ENTER  LAMBDA#  THE  AUT0C0RRELATI0N  C0EFFIC I ENT 
.3 


**  STARTUP  RUNS  F0R  UNIF 


789 


. -• 


**  LEVELS  0F  FACT0R  A - 2 

**  LEVELS  0F  FACT0R  B « 3 

**  SAMPLE  SIZE  - 4 

**  VECT0R  DIMENSION  IS  4 

**  ITERATI0NS  SAMPLE  SIZE  « 500 

**  ALPHA  = .05 

**THE  VALUE  0F  LAMBDA  IJ  .30 

**  SIZE  NORM  T0  DETECT  IS  2.00 

**  N0RM  1 IS  SPECIFIED 

2.00 


**  NORM  RATIO  IS 

♦*  SIGMA  MATRIX 


I .00000 

.66000 

.68000 

1 .00000 

-.49000 

-.21000 

.56000 

.72000 

**  c 

MATRIX  ** 

1.00000 

0.00000 

.68000 

.73321 

-.49000 

.16803 

.56000 

.46262 

** 


-.49000 

.56000 

-.21000 

.72000 

1 .00000 

-.26000 

-.26000 

1 .00000 

0.00000 

0.00000 

0.00000 

0.00000 

.85538 

0.00000 

-.07404 

.68330 

75 


f 
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K 


$ 

* 


it 


I 


**  MEAN  VECT0R  ** 


0.00000 


0.00000 


0.00000 


0.000*00 


IS  YOUR  INPUT  CORRECT  ? 
? YES 


♦♦  POWERS  0F  THE  TESTS 


SAMPLE  SIZE 
4 


P0VER  0F  TEST 
.61400 


##  D0  YOU  DESIRE  T0  MAKE  AN0THER  RUN? 
? N0 

40.234  CP  SECONDS  EXECUTION  TIME 


li 
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PROGRAM  MANOVAC INPUT,  OUTPUT, TAPE5-INPUT,TAPE6«0UTPUT) 

REAL  LAMBDA 
INTEGER  ERROR 

COMMON  /ONE/  E(20,20),H1 (20,20 ) ,HD( 20, 20 ) 

COMMON  /TWO/  NL 
COMMON  /THREE/  K0RDC2O) 

COMMON  /FOUR/  KUSEDC20) 

COMMON  /FIVE/  SIGMAC20,20) 

COMMON  /SIX/  CMAT(20,20) 

COMMON  /SEVEN/  ZVEC <20 ) , UC 20 ) ,XVEC ( 20) ,BUFC 20 ) 

Common  /nine/  facc20) 

Common  /eleven/  ni 
Common  /tvel/  lambda 

DIMENSION  DC0MC20) 

DIMENSION  A<3,5),C<3,5,20),T(5,20),R<3,20) 

DIMENSION  Y1AC5, 100,20), Y2A( S, 1 00, 20 ) , Y3AC 5, 1 00, 20 > 
DIMENSION  G(20),v)D(20),H2(20,20),H3(20,20),Z(20,20),IPR(20) 
DIMENSION  I EUC  <2),ISUP(2) 

EXTERNAL  UNI F, RN0RM1 , CMAT1 , PI  CHI , V IPDA, CHIPRB 
DATA  KN0RM/6HEUC  / 

DATA  ISUP  /6HSUPREM,6H0M  / 

DATA  I EUC  /6HEUCL1D,6HEAN  / 

F0RMAt<  1H1,2X,"ERR0R**READ  PAST  END  OF  FILE**") 
F0RMATC1H1,2X,"ERR0R**PR0BLEM  IN  CHI  SQUARED  ROUTINE**") 
FORMATC  1H1,2X,"ERR0R**PR0BLEM  IN  GOR  ROUT INE**" ) 

FORMAT  < IH1,  10X, "**  MANOVA  POWER  PROGRAM  **") 

FORMATC//, 10X,"**  ALPHA  =",F5.2) 

FORMATC //, 1 OX, "**  VECTOR  DIMENSION  IS  ",I2> 

F0RMAT( //, 1 OX, "**  POWERS  OF  THE  TESTS") 

FORMATC //, 1 OX,"**  SIZE  NORM  TO  DETECT  IS  ",F5.2) 

FORMATC //, 10X,"**  LEVELS  OF  FACTOR  A = ",I3) 

FORMATC//, l OX, "SAMPLE  SI ZE",9X, "POWER  0F  TEST") 

FORMATC//, 1 OX,"**  LEVELS  OF  FACTOR  B = ",I3> 

FORMATC /, 14X, 13, 16X, FI  0.5) 


FORMATC//, 1 OX,"**  SAMPLE  SIZE  = ",I3> 

FORMATC //, 1 OX,"**  ITERATIONS  SAMPLE  SIZE  = ",I3) 

FORMATC//, I OX,"**  MEAN  VECTOR  **") 

FORMATC //, 10X,"**  SIGMA  MATRIX  **"> 

FORMATC//, 1 OX,"**  C MATRIX  **“> 

FORMATC //,2X,"ENTER  THE  SIGMA  MATRIX") 

FORMATC //,2X,"ENTER  THE  MEAN  VECTOR") 

FORMATC //, 2X, 5 ( 2X, FI  0 .5 ) ) s . 

FORMATC  //,  2X,  "IS  YOUR  INPUT  CORRECT  ?"•) 

FORMATC  /, 2X, "ENTER  THE  TYPE  NORM  YOU  DESIRE  TO  USEl EITHER" ) 
F0RMAT(,2X, "EUC  FOR  EUCLIDEAN  OR  SUP  FOR  SUPREMUM") 

FORMATC  /, 10X,"**  NORM  USED  IS  ",2A6> 

FORMATC  //,2X,"*#  DO  YOU  DESIRE  TO  MAKE  ANOTHER  RUN?") 

FORMATC  /, 2X, "DO  YOU  DESIRE  TO  CHANGE  ONLY  SAMPLE  SIZE, ALPHA, 
1 NORM?") 

FORMATC  /,2X, "ENTER  THE  SAMPLE  SIZE") 

FORMATC  /, 2X, "ENTER  ALPHA”)  ' ' 

FORMATC A6) 

FORMATC  /,2X, "ENTER  THE  SIZE  NORM  YOU  DESIRE  TO  DETECT") 
FORMATC  /, 2X, "ENTER  THE  NR  OF  LEVELS  OF  FACTOR  A") 

FORMATC  /,2X, "ENTER  THE  NR  OF  LEVELS  OF  FACTOR  B" ) 

FORMATC  /,2X, "ENTER  THE  DIMENSION  OF  THE  RESPONSE") 

FORMATC  /,2X, "ENTER  THE  ITERATIONS  SAMPLE  SIZE") 

FORMATC  /,2X, "ENTER  THE  NR  OF  STARTUP  RUNS  FOR  UNIF") 

FORMATC  /,!0X,"**  STARTUP  RUNS  FOR  UNIF=  ",I5) 

FORMATC /,2X," DO  YOU  DESIRE  TO  SPECIFY  ALL  NORM  COMPONENTS?") 
FORMATC /,2X, "ENTER  THE  NORM  INDEX  TO  BE  SPECIFIED") 


0162  F0RMATC/,  10X,'***  DCOMC",  12/**)  »",F 5.2) 

0163  F0RMATC/,  10X,"**  N0RM  •*,  12,'’  I S~  SPEC  1 FI  ED"  ) 

0164  F0RMATC /,  2X, "VHAT  N0RM  RATI0  D0  YOU  WANT  T0  USE?” ) 

0165  F0RMATC/, 10X, ”**  N0RM  RATIO  IS  "F5.2> 

0166  F0RMATC  /,  2X,  ’’ENTER  LAMBDA, THE  AUT0C0RRELATI  0N  COEFFICIENT 

0167  F0RMAT< /, 1 OX,  "**THE  VALUE  OF  LAMBDA  ISM  F5.2) 

DATA  IRES/6HYES  / 

C 

C **  INPUT  SECTION  ** 

C 

VRI TEC  6,01 1 2 > 

VRl TE(6,Q 158) 

READC 5,*)  KSU 
1 F ( E3F ( 5 ) > 9791,20 

20  DO  0600  I “1 ,KSU 
zsu«unifca) 

0600  CONTINUE 
0900  WRITE(6,0153> 

READC  5,  * ) N I 
IFCE0FC5))  9791,21 

21  VRI TEC  6, 01 54) 

READC  5,  *)  NJ 

IFC  EOF C 5 > ) 9791,22 

22  VRITEC6,01 55) 

READC5,*)  NL 
IFCE0FC5))  9791,23 

23  WRITEC6,0 149) 

READC  5, *)  N 14 
IFCE0FC5))  9791,24 

24  WRI TEC  6, 0 150) 

READC 5,*)  ALPHA 
IFC  EOF C 5 ) ) 9791,25 

25  VRITEC6,0 1 60 ) 

READC  5,0151)  LN0R 
IFCLN0R.NE. IRES)  GO  T0  0902 
VRI TEC 6, 01 61 ) \ 

READC  5,  * ) IDX 
VRITEC6,0 164) 

READC 5, *)  RATIO 
0902  VRI TEC  6,0152) 

READC5,*)  DC 
1FCE0FC5))  9791,0904 
0904  VRITEC6,0 1 57) 

READC  5,  * ) NN 
IFCE0FC  5) ) 9791,26 

26  1FCLN0R.EQ.IRES)  GO  TO  0906 
VRI TEC  6, 0 144) 

WP-1  TEC  6,0  145) 

READC 5, 0 151)  NORM 
0908  VR1TEC6,0 137) 

READC5,*)C  CSIGMAC I,U),U»1 ,NL),I-1,NL) 


IFCE0FC5))  9791,27 
27  VRITEC6,Q 139) 

READC  5, * ) < U( I ), 1-1 ,NL) 

IFCE0FC5))  9791,28 
26  WRITEC 6,0166) 

READC 5,*)  LAMBDA 
1 F( EOF C 5 ) ) 979 1,41 
41  60  T0  0915 

0910  VfRIT£(6,0  1 49) 

READ( 5, *)  N 1 4 
IF( E0F( 5) ) 9791,29 

29  WRITE<6,0 166) 

READ( 5, * ) LAMBDA 
IF( E0FC  5 ) ) 9791,40 

40  WRITEC  6,0150) 

READC 5,*)  ALPHA 
1FCE0FC5))  9791,30 

30  WRITEC  6,0 1 52 ) 

READC5,*)  DC 
1FCE0FC5))  9791,31 

31  WRITEC6,0 1 61 ) 

READC  5, * ) IDX 
IFCE0FC  5) ) 9791,0915 

0915  CALL  CMAT1 

WR1 TEC 6,0 159)  KSU 
WRITEC  6,0121 ) N I 
VR1T£C6,0 123)  NJ 
VRlT£C6,0 125)  NI4 
WRITEC6,01 16)  NL 
WRITEC  6,0127)  NN 
VRl TEC  6,01 14)  ALPHA 
WRITEC  6, 0 167)  LAMBDA 
WRITEC 6, 120)  DC 
1FCLN0R.EQ. IRES)  60  T0  916 
60  T0  917 

0916  WRITEC6, 0 163)  IDX 
WRlT£C6,0165>  RATIO 
60  T0  0930 

0917  IFCN0RM.NE.KN0RM)  G0  T0  0920 
WRITEC6,0146)  IEUC 

60  T0  0930 

0920  WRITEC  6,0 1 46)  ISUP 
0930  CONTINUE 

WRITEC  6, 0 1 31 ) 

D0  940  I -1 ,NL 

WRI TEC  6,0141 ) C SIGMA  CI,J),J-1, NL) 
940  CONTINUE 

WRITEC  6,0133) 

D0  950  I -1 , NL 

WRITEC6,0 141 ) CCMATC I, J), J=1,NL) 
950  CONTINUE 


VRITE<6,0128) 

VRlTE<6,0141 >(U< I ),  1*1 ,NL) 

VRIT£C6,0 143) 

READ<  5, 0 151)  IZ 
IFC IZ.NE. IRES)  G0  T0  0900 
P0VER=0.0 
C 

C **  COMPUTE  THE  CRITICAL  VALUE  0F  THE  TEST  STATISTIC  ** 

C 

CALL  CRIT(NI,NJ,NI4,NL,ALPHA,P1CHI,CHIPR£,CRITV,£RR0R) 
lF< ERROR. EQ.l)  G0  T0  9795 
C 

C **  L00P  ON  REPLI CATI0N  F0R  THIS  N0RM  ** 

C 

D0  8500  12*1, NN 
IF<LN0R.EQ« IRES)  G0  T0  0990 
CALL  0RDERCNL, UN IF) 
lF( N0RM.NE.KN0RM)  GO  T0  0970 
CALL  ASGN0R<DC,DCOM,UNIF) 

G0  T0  0990 

0970  CALL  ASGMAX<DC,DCOM,UNIF> 

C 

C **  L00P  0N  ITERATIONS  ** 

C 

0990  IF(LNOR.NE.IRES)  G0  T0  1020 
DO  1000  LL*1,NL 
IF(LL.Efi.IDX)  G0  T0  0995 
DC0MCLL)=UNIFCA)*DC/RATI0 
G0  T0  1000 
0995  DC0MC  LL) =DC 
1000  CONTINUE 
1020  D0  1050  13* 1 « NL 

CALL  0RDERC  NI, UNIF) 

CALL  FACOMCDCOMC 13) ) 

DO  1030  111*1  ,NL 
DO  1029  Jjj-1,NI 
A( JJ J, 1 1 1 ) *0  *0 

1029  CONTINUE 

1030  CONTINUE 

D0  1040  KC*1,NI 
JR«K0RD(KC) 

A< JR, I3)-FAC(KC) 

1040  CONTINUE 
1050  CONTINUE 
C 

C **  GENERATE  THE  OBSERVATIONS  ** 

C 

DO  1500  II«1,NI 
D0  1490  JJ*1,N0 

DO  1 480  KK*1 , NI4 
IREPS*KK 
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CALL  XVEC1 (RN0RM1,UNIF, IREPS) 

00  1470  LLb1 «NL 
IFClI.NE.l ) G0  T0  1501 
Y1ACJU..KK, LL) *A Cl  It LL)+XV EC( LL) 

1501  IFCII.NE.2)  G0  TO  1502 

Y2A ( JJ  , KK, LL) *A( 1 1*  LL) +XV EC  < LL ) 

1502  IFCII.NE.3)  G0  TO  1470 
Y3ACUJ,KK,LL)«AC  1 I/LD+XVECCLL) 

1470  CONTINUE 
1480  Continue 
1490  CONTINUE 
1500  CONTINUE 
C 

C **  COMPUTE  THE  MANOVA  ** 

C 

C **  COMPUTE  THE  CELL  MEANS  ** 

C 

DO  1600  I C“1  .»NI 
DO  1590  j C * 1 > N j 
D0  1580  LC“ 1 t NL 
SUM»0.0 

DO  1570  KC “ 1 * N 1 4 
IFCIC.NE.l)  GO  TO  1571 
SUM«SUM+Y1 ACJC^KC#  LC ) 

1571  IF( I C • NE .2 ) GO  TO  1572 
SUM=SUM+Y2ACJC,KC,LC) 

1572  IFCIC.NE.3)  GO  TO  1570 
SUM»SUM+Y3AC  JC.,KC,LC) 

1570  CONTINUE 

CCICsJCsLC ) “SUM 
1580  CONTINUE 
1590  CONTINUE 


1600  CONTINUE 
C 

C **  COMPUTE  THE  COLUMN  TREATMENTS  ** 
C 

DO  1700  JC“1 t NJ 
DO  1690  LCBi ,*NL 
SUM«0.0 

DO  1680  IC-UNI 
DO  1670  KC-UNI4 
IFCIC.NE.l ) GO  TO  1671 
SUM“SUM+Y1ACJC,KC.»LC) 

1671  IFCIC.NE.2)  GO  TO  1672 
SUM»SUM+Y2AC JC/KCrf LC) 

1672  IFCIC.NE.3)  GO  TO  1670 
SUM-SUM+Y3A<JC#KC^LC) 

1670  CONTINUE 
1680  CONTINUE 

TCdC*  LC ) “SUM 
1690  CONTINUE 


c 

C **  C0MPUTE  THE  R0V  TREATMENTS 

c 

00  1600  IC“1 jNI 
00  1790  LC»1,NL 
SUM=0.0 

00  1780  JC»hNJ 
D0  1770  KC-UNI4 
IF(IC.NE.l)  G0  T0  1771 
SUM-SUM+Y1 A ( JC*  KC*  LC  ) 

1771  IFCIC.NE.2)  G0  T 0,  1772 
SUM=SUM+Y2A( JC^KC^LC) 

1772  IFCIC.NE.3)  GO  TO  1770 
SUM-SUM+Y3A<JC.,KC,LC> 

1770  CONTINUE 
1760  Continue 

RCIC-rLO-SUM 
1790  CONTINUE 
1800  CONTINUE 
C 

C **  COMPUTE  THE  GRAND  TOTALS 

c 

D0  1900  LC-1 » NL 
SUM-0.0 

D0  1890  KC-1 *NI4 
D0  1380  JC=1 #NJ 
00  1670  IC-1 /Nl 
IFCIC.NE.l)  GOTO  1871 
SUM=SUM+Y1A( JC/KC/LC  ) 

1871  IF(IC.NE.2)  G0  TO  1872 
SUM-SUM  + Y2ACJC/KC/.LC) 

1872  IF(IC.NE.3)  GO  TO  1870 
SUM-SUM+Y3AC  JC/ KC/ LC ) 

1870  CONTINUE 

1880  Continue 
1890  Continue 
G( LC ) “SUM 
1900  CONTINUE 
C 

C **  COMPUTE  THE  HI  MATRIX  ** 

C 

00  2000  1L-1/NL 
DO  1990  jL-l/NL 
SUM-0.0 

DO  1980  I CB1 /Nl 
SUM=SUM+fK  1C* lL)*RC IC/ JL) 
1980  CONTINUE 

NJK=NJ*NI4 

Yl-NJK 

SUM-SUM/Y1 


** 


Yl=NIJK 

H 1 < I L.*  JL)  “SUM-G  ( I LI  *G  < JL)/Y1 
1990  CONTINUE 
2000  CONTINUE 
C 

C **  COMPUTE  THE  E MATRIX  ** 

C 

DO  2100  IL«1/Nl 

DO  2090  JL»1,NL 

SUM1 =0 .0 

D0  2060  I C = 1 .» NI 

D0  2050  JC-1,NJ 

00  2040  KC  “WNI4 

IFC IC.NE. 1 ) GO  TO  2041 

SUMl-SUMl  + Y1A(JC.»  KC  * IL)*Y1A(JC«KC*JL) 

2041  IF( IC  «NE*2 ) G0  t0  2042 

SUM1  “SUM  1 ♦ Y2AC  JC#  KC.*  I L) *Y2A ( JC*  KC*  JL) 

2042  IFCIC.NE.3)  G0  T0  2040 

SUM l “SUM 1 +Y3A( JC*  KC* I L) *Y3AC JC* KC* JL) 
2040  CONTINUE 
2050  CONTINUE 
2060  CONTINUE 
SUM2“0 .0 
DO  2060  IC“1 *NI 
DO  2070  JC=UNO 

SUM2«SUM2«-C<IC*  JC* IL)*C< IC*  JC*  JL) 

2070  CONTINUE 
2080  CONTINUE 
Y 1 “Nl 4 

E<  IL* JL) “SUM1 -SUM2/Y1 
2090  CONTINUE 
2100  CONTINUE 

1FCNI4.NE.1)  GO  T0  2600 
C 

C **  COMPUTE  THE  H2  MATRIX  ** 

C 

00  2200  I L“1  j NL 
DO  2190  JL=1,NL 
SUM  *0.0 

D0  2180  JC*1*NJ 

SUM*SUM  + T(JC*IL) *T(JC*JL> 

2180  CONTINUE 

Yl“(NI*NI4) 

SUM*SUM/Y1 
Y 1 =(NI*NJ*NI4) 

H2(  IL*  JL)  “SOM  - G< IL)*G<JL)/Y1 
2190  CONTINUE 
2200  CONTINUE 
C 

C **  COMPUTE  THE  TOTALS  MATRIX  ** 
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.. . 


k 


2241 

2242 

2240 

2250 

2260 


2290 

2300 

C 

C ** 

C 


2390 

2400 

C 

C ** 
C 


2490 

2500 

C 

C ** 
C 

2600 


00  2300  IL-1jNL 
D0  2290  jL=l,NL 
SUM1-0.0 

D0  2260  IOlsNI 

00  2250  JC-l.»Nj 

00  2240  KC  ■ 1 / N 1 4 

IFdC.NE.l)  GO  TO  2241 

SUM1 *SUM1 +Y1A(UC«KC*IL)*Y1A( JCsKCsUL) 

IFCIC.NE.2)  G0  T0  2242 

SUM1 =SUM 1 +Y2A< JC, KC  j I L) *Y2A< JC, KC, JL ) 

IF(IC.NE.3>  G0  T0  2240' 

SUMl»SUMl+Y3A(JC.*KC,IL>*Y3A( JC,KC, JL) 

CONTINUE 

Continue 

Continue 

Y1«<NI*NJ*NI4> 

Z( ILjJL)  ■ SUMl  - G(IL>*G(JL)/Yl 
CONTINUE 

Continue 

COMPUTE  THE  H3  MATRIX  ** 

00  2400  IL-1,NL 
DO  2390  JL-1jNL 

H3< IL, JL)*Z< IL,JL>-H1 ( IL,UL>-H2( IL, JL)-E( IL, JL) 
CONTINUE 

Continue 

i 

REPLACE  E MATRIX  WITH  H3  MATRIX  ** 

00  2500  I L*=  1 1 NL 
DO  2490  JL-I >NL 
E(  IL#JL)=H3C  IL,  JL) 

CONTINUE 

CONTINUE 

COMPUTE  THE  TEST  STATISTIC  OF  THE  MAN0VA  ** 
CALL  MATA 00 

CALL  DEC0M( E>20»NL«JD« IPR.,01 « VIPDA) 

0ET-D1  ' 

DO  10  I-WNL 
DET-DET*ECI.,I)  • 

ED-DET 

CALL  DEC0M(HD#20#NL« JD/ IPR*  D1 * VIPDA) 

0ET-D1 

DO  11  I-UNL 
DET«DET*HDCI,I> 


c 

c ** 

c 


3000 

8500 

C 

C ** 
C 

$791 

9793 

9795 

C 

C ** 
C 

9801 

C 

C ** 

C 


35 


36 

9990 


85 


HT-DET 

CV-ED/HT 

TEST  THE  CRITICAL  VALUE  0F  THE  TEST  STATISTIC  ** 

IF(CV.GT.CRITV)  GO  T0  3000 
POWER-POWER*  1.0 
CONTINUE 

Continue 

G0  T0  9801 

ERROR  MESSAGES  ** 

WRITE!6#0 101 ) 

G0  TO  9601 
WRITE!6#0 105) 

GO  TO  9801 
WRITE!6#0103) 

GO  TO  9801 

COMPUTE  THE  POWERS  BY  SAMPLE  SIZE  ** 

V-NN 

P0WER-POWER/W 

OUTPUT  SECTION  ♦* 

WR1TE!6#0 1 18) 

WRITE! 6#  0 122) 

WRlT£(6#0124>  NI4#P0WER 
WRlT£(6#0 147)  * 

READ! 5/0151 ) IZ 

IF! EOF! 5) ) 979 1*35 

IF! IZ.NE. IRES)  GO  TO  9990 

VTRlTE!6«0l48) 

READ! 5^0 151)  IZ 

IF!  EOF!  5)  ) 9791.#  36 

IF! IZ.NE. IRES)  GO  TO  0900 

GO  TO  0910 

CONTINUE 

STOP" 

END 
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SUBROUTINE  CRI TC NI,NJ, 14, NL, ALPHA, PICHI,CHIPRB,CRITV, ERROR) 
C **  THIS  SOBRoOTlNE  COMPUTES  THE  SECOND-ORDER  APPROXIMATION 
C **  OF  THE  CRITICAL  VALUE  OF  THE  MAN OVA  TEST  USING  THE  BOX 
C **  METHOD  BY  MEANS  OF  A NONLINEAR  SEARCH  OPTIMIZATION 
C «*  ROUTINE  FOR  A GIVEN  PROBABILITY  OF  TYPE  I ' ERROR,  ALPHA. 
INTEGER  ERROR 
S-i;  - ALPHA 
K0UNT-1 
DEL -.01 
P-NL 

Gl-CNI-I) 

SN-CNl*NJ*C 14-1 ) > 

IF( 14. EQ. 1)  SN-<Nl-l)*CNJ-i > 

ZR-NI 

BN-Sfl-t-ZR 

02-ZR-Q1 

CM-BN-G2-.5+CP+Q1+1 .) 

G»CP*Q1 *(P**2+ttl**2-$. ) >/48  • 

KDFl»NL*CNI-l ) 

KDF2-KDFI+4 

AKDFl-KDfl 

AKDF2-KDF2 

X-P ICHI C S, AKDF 1 , IR) 

IFC Ifi.EG. 1 .0R.IR.EQ.2)  GO  TO  900 
100  APT-CHIPRBCX,AKDFl,IR) 

BPT-CHIPRB(X,AKDF2, IR) 

Z*APT+CBPT-APT)#G/C  CM**2) 

IFC IR.EQ.l .0R.IR.EQ.2)  GO  TO  900 
XEVF-S-Z 

IFCXEVF.LT. 0.0)  XEVF—  XEVF 
1FCK0UNT.NE.1 ) GO  TO  200 
MOUNT -KOUNT+l* 

150  Y-X 

X-Y+DEL 
OLDF-XEVF 
GO  TO  100 

200  IFC  XEVF -OLDF ) 20 1 , 20 1 , 202 

201  IFCXEVF.LT. .00001 ) GO  TO  800 
DEL-DEL*3.0 

OLDF -XEVF 
GO  TO  150 

202  DEL-DEL*C -.5) 

X-Y 

XEVF -OLDF 
GO  TO  150 

800  CRITV-EXPCX/C -CM) ) 

GO  TO  950 
900  ERROR- 1 

GO  TO  990 
950  ERROR-2 
990  CONTINUE 
RETURN 
END 


$ 


1 
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SUBROUTINE  ORDER < N#  UN I F ) 

C **  THIS  SUBROUTINE  RANDOMLY  ASSIGNS  0RDER  TO  A P-DIMENS I0NAL 
C **  VECT0R * S COMPONENTS. 

COMMON  7THREE/  KORDC 20) 

C0MM0N  /FOUR/  KUSEDC20 > 

D0  100  1°I<N 
KORDC I >*0 
KUSEDC 1 )-0 
100  CONTINUE 
LEFT-N  ' 

D0  500  J«1,N 
X-UNIFCX) 

D0  400  K-l, LEFT 

Y-FL0ATOO 

Y«Y/FLOAT<LEFT> 

IF(X.GT.Y)  G0  T0  400 
LU-0  ' 

DO  300  M«1,N 

IF(KUSEDCM) .NE.0)  G0  T0  300 
LU-LU+1  " ' 

IFCLU.NE.K)  00  T0  300 
KUSEDCM>-1 ' 

KORDC J)-M 
G0  T0  450 
300  CONTINUE 

400  Continue 

450  LEFT-LEFT- I 
SOO  CONTINUE 
RETURN 
END 


SUBROUTINE  MATADD 

COMMON  /ONE/  EC20, 20 ) j H It 20, 20 > #HDC 20/ 20 > 

Common  /two/  nl 
DO  100  1-1 #NL 
DO  90  J-1<NL 
HD(  hJ)*E(I<J)+Hl(,  J> 

90  Continue * 

too  CONTINUE 
RETURN 
END 


— - 
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S UBROUTINE  ASGMAXC  D*  DCOM*  UNI F) 

C **  THIS  SUBROUTINE  RANDOMLY  ASSIGNS  THE  COMPONENTS  OF  A SUPREMUM 
C **  NORM  SUCH  THAT  THE  COMPONENTS  ARE  IN  NORM  EQUAL  TO  THE  ORIGINAL 
C **  NORM. 

COMMON  /TWO/  N 
COMMON  /THREE/  K0RD(20> 

DIMENSION  DC0MC20) 

M“N- 1 ‘ * 

DO  100  l*l*M 
U=K0RD( 1 ) 

DC0M<U>iD*UNIF(A> 

100  CONTINUE  • - - 
J=K0RD( N) 

DC0M(«I)*D 
RETURN  * 

END 


SUBROUTINE  XVEC 1 ( RN0RM1  * UNI F* I REPS) 

C **  THIS  SUBROUTINE  GENERATES  MULTIVARIATE  N0RMAL  AUT0CORRELATED 
C **  VECTORS  USING  THE  TRANSFORMATION  Y=CX+U*  WHERE  C IS  THE 
C **  MATRIX  FROM  SUBROUTINE  CMAT*  LAMBDA  IS  THE  AUTOCORRELATION 
C **  COEFFICIENT*  AND  X IS  A P- DIMENSIONAL  VECTOR  FROM  N<0*1). 
COMMON  /TWO/  N 

Common  /six/  cmatc2o*20> 

COMMON  /SEVEN/  ZVECC  20 ) * U( 20 } *XVEC (20 ) *BUF( 20 ) 

COMMON  /TWEL/  LAMBDA 

Dimension  oldvec(20>*vecnevc20> 

If (IREPS.NE.n  GO  TO  90' 

DO  27  I*1*N*2 

ZVEC( I >*RN0RM1 <UNIF*RN0RM2*O .0* 1 .0} 

11*1+1 

2VEC( 11) *RN0RM2 

27  CONTINUE 
GO  TO  1000 

90  DO  1 1*1* N 

oldVeCc 1 ) =ZVEC< 1 ) 

1 CONTINUE 

DO  28  I *1 *N* 2 

VECNEWC I>“RN0RN1CUNIF*RN0RM2*O.O* 1.0) 

I 1*1+ 1" 

VECNEWC I I > *RN0RM2 

28  CONTINUE  ' 

DO  29  I *1  * N 

ZVECC I ) *LAMBDA*OLDVEC  C 1 > + < 1 . -LAMBDA >*VECNEV( I > 

29  CONTINUE 

1000  DO  121  1*1 *N 

SUM*0.0 ’ 

DO  111  J-1*N 

SUM-SUM+CMATC I* J)*ZVEC<U) 

111  CONTINUE  

BUFtl>-SUM 
121  CONTINUE 

DO  1 31  R=1*N 
XVEC(K>»BUF(K>+U<K> 

131  CONTINUE 

RETURN  ‘ 

END 


SUBROUTINE  ASGN0R< D.DCOM.UNIF) 

THIS  SUBROUTINE  RANDOMLY  ASSIGNS  THE  COMPONENTS  OF  A EUCLIDEAN 
NORM  SUCH  THAT  THE  COMPONENTS  ARE  IN  NORM  EQUAL  TO  THE  ORIGINAL 
NORM.  ' * * * * * 

COMMON  /TWO/  N 
COMMON  /THREE/  K0RD!2O) 

Dimension  dcom<20>  " 

R-D**2 

MaN- 1 

DO  100  I-l.M 
J-KORD!i> 

DCOMU>-R*UNIF!A> 

RiR-DCOMtU)  * ' * 

CONTINUE 

O-KORD(N) 

DCOMUJ-R 

DO  200 ' K-l . N 

DCOMC K) -SORT!  DCOM(K) ) 

CONTINUE 

RETURN 

END 


SUBROUTINE  CMAT1 

THIS  SUBROUTINE  COMPUTES  THE  C-MATRIX  REQUIRED  TO  GENERATE 
MULTIVARIATE  NORMAL  RANDOM  VECTORS.  SUCH  THAT  CC-SIGMA. 
WHERE  SIGMA  IS  THE  POPULATION  COVARIANCE  MATRIX.* 

COMMON  /TWO/  N 

COMMON  /FIVE/  SIGMAI20.20) 

COMMON  /SIX/  CMATI20.20)  ' 

DO  110  d-I.N  ’ 

1FIJ.GE.2I  GO  TO  91 
DO  81  1-1. N 

CMATC i; 1 )-SI GMA! I. 1 >/ SORT! SIGMA! 1.1)) 

CONTINUE 

60  TO  110 
DO  105  1-1. N 
IFU.GE.I*1>  GO  TO  104 
IFU.NE.l)  GO  TO  95 
SUB 1-0.0 
L-l-1 

DO' 93  K-I.L 

SUB1-SUB1+CMAT(1.K>**2 

CONTINUE 

CMAT! 1 . J ) -SORT! SIGMA! I. J ) -SUB1 } 

GO  TO' 105 

SUB2-0.0 

L-J-l 

DO  91  K-l.L 

SUB2-SUB2* CMAT! I . K> *CMAT! J. K) 

CONTINUE  

CMAT!  !.•))■!  SIGMA!  I.«l ) -SUB2  )/CMAT!J.  J) 

GO  T01OS  

CMAT! I.J) -0.0 
CONTINUE 

Continue 
RETURN  ' 

END 
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SUBROUTINE  FAC0MCD) 

COMMON  /NINE/  X< 20) 

COMMON  /ELEVEN/  NI' 

DO  50  1-lsNI 
XUJ-0.0 
50  CONTINUE 
lMOD*C 

Y-NI 

NN«NI 

IFCAM0D<Y*2.).GT..1  ) IM0D-1 

I Ft IMOD.EO. 1 > NN-NN-1 

Y-NN 

R-D/Y 

R-S8RTCR) 

00  100  I»1,NN,2 
X( 1 )"R 
11*1+1 
XIII)— R 
SOO  CONTINUE 

IFt  IMOD.Efl. 1 > XCND-O. 

RETURN 

END 


FUNCTION  UNIF(A) 

DATA  1U/3 1415926531/ 

UMX»20007777777777777777B 

IX-16777213 

1V-1V*1X 

U-IO 

U"i U/UMX) 

IFCU.LT.O)  U-U+l. 

UNIF-U 

RETURN 

END 


. 


1 1 - 


K I 


-"v 


«*■  ■"  ™ ? 


r,-^-rvTM..  IJU...'. 
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APPENDIX  B 


This  appendix  contains  a complete  FORTRAN  IV  listing 
of  the  program  which  computes  the  multiple  correlation 
coefficients  of  a set  of  responses,  given  the  sample 
correlation  or  covariance  matrix.  The  program  is  interactive 
and  input  is  free-field  format.  An  example  of  its  use  is 
also  given. 
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***  MULTIPLE  C0RRELATI0N  C0EFFICI ENT  PROGRAM  *** 

ENTER  THE  DIMENSION  0F  THE  RESP0NSE 
7 

ENTER  THE  SAMPLE  C0 VARIANCE  MATRIX 
i » * •00/*t06i*«l2/ . 00# • • 17« • 16 

• 00 * 1 •/•01/~«1 1 * .01***  t04< *76 
"•06*  • 01 * 1 • * >66j,*i49«  • 56*  .07 
"»12*".ll*. 68 * 1 »* " • 21 * •72/*<04 

• 00  * .01*~.49*~ .21* 1 . * — • 26* " » 1 1 
" • 1 7*  -*,04*  *56*  • 72*  - .26*  1 • * ** • 08 

• 1 6* • 76* .07* • • 04*  — • 1 1 * — *08* 1 • * 


RC  1 >462  - 

.0861 14 

* * 

R<  1) 

.293452 

* 

R<2>**2  » 

.623385 

RC2)  ■ 

.78  9547 

R<3)**2  » 

.597087 

R<  3)  ■ 

.772694 

R<4)**2  = 

.665777 

RC4)  « 

.815951 

R<5>**2  ■ 

.303452 

R<5> 

.550865 

j 

R(6>**2  - 

.558023 

* 

1 

R<  6 ) ■ 

.747010 

R<7>**2  ■ 

.632303 

♦ 

R<  7) 

.795175 

DETERMINANT 

IS 

.06341 

•487  CP  SEC0NDS  EXECUTION  TIME 


PROGRAM  MLTC 0R ( INPUT* OUTPUT*  TAPES* INPUT , TAPE6- OUTPUT) 

INTEGER  POSC 20) 

DIMENSION  S! 20, 20 ),C! 20,20), SI  2(20,20)# SI 2T!20, 20) ,S22!20,20) 
DIMENSION  JD!20),A!20,20 ) ,B( 20 , 20 ) , 1 PRC 20 ) 

DIMENSION  UL! 20,20),  RR! 20, 20 ) ,X!20, 20 ) 

EXTERNAL  VI PDA 
VRI TEC  6*101  ) 

101  FORMAT! /,  5X,”***  MULTIPLE  CORRELATION  COEFFICIENT  PROGRAM  ***") 
VR1TEC6, 103 ) 

103  FORMAT! /,2X,” ENTER  THE  DIMENSION  OF  THE  RESPONSE” ) 

READ! 5,  *)  NL 
VR 1 TE!6, 105) 

105  FORMAT! /,2X,” ENTER  THE  SAMPLE  COVARIANCE  MATRIX”) 

READ!5,*)!!C!1,J),J-1 <NL)/I>1«NL) 

N2-NL-1 

Nl-l 

DO  900  IP-1,  L 
IFUP.NE.l)  GO  TO  175 
DO  150  IC-1,NL 
POSIIO-IC 
150  CONTINUE 
GO  TO  200 
175  POS! 1 )-IP 
P0S!2 )- 1 
IK-2 

DO  190  IC-3,NL 
IF1IP.EG.IK)  IK-IK+1 
POS! IC)-IK 
IK-1K+1 

190  CONTINUE 
200  CONTI  N!JE 

DO  250  1C-1 ,NL 
1A-P0S! IC) 

DO  240  JC  = 1 , NL 
JA=P0S  ! JC  ) 

S!IC,dC)-C!IA,JA) 

240  CONTINUE  ' 

250  CONTINUE 

DO  300  IC-I,N2 
IA-IC+1 

DO  290  JC-i ,N2 
JA-JC+1 

S22! IC, JC)-S! IA,JA> 

290  CONTINUE 
300  CONTINUE 

DO  320  JC»1,N2 
JA*JC* 1 

S12T! 1,JC)=S! 1,JA) 

320  CONTINUE 

DO  340  IC-I ,N2 
lA-ICfl 

S 1 2! I C,1  )“S!IA,1  ). 

340  CONTINUE 
L-0  ' 

CALL  INVI TR<  S22, UL, 20, N2, I PR, RR,X, D1 ,L, DX, KD) 

IF! D1 • EQ . 0 ) GO  TO  950 

CALL  FMMX!S12T,X,A,N1 ,N2, 20, 20,20, N2> 

CALL  FMMXC A, SI 2,B,N1 ,N2,20,20,20,N1) 
fi-E! 1, 1 )/S! 1, 1 ) 

WRITE! 6, 109)  IP,R 

109  FORMAT!  //, 2X,”R!”, 1 1 ,")**2  -”,F10.6) 


R-SGRT(R) 

VRITEC6, 1 1 1 > IP..R 

111  FORMAT  ( /»  2X*  "RC  1 1 * '*  > •",F10.6> 

900  CONTINUE 

CALL  DECOM!  C*20«NL* JD« IPR^Dl , VI PDA) 
DET-D1 

00  10  1*1 <NL 
10  DET*DET*C! 1*1) 

D*DET 

URITEC6/113)  D 

113  FORMAT! //#2X, "DETERMINANT  IS  **>F10.5) 

950  CONTINUE 
END 


95 


APPENDIX  C 

This  appendix  contains  a complete  FORTRAN  IV  listing 
of  a program  which  computes  the  test  statistic  used  to  test 
if  two  sets  of  responses  are  independent.  The  program  is 
interactive  and  the  input  is  in  free-field  format.  An 
example  of  its  use  is  also  given. 


♦♦TEST  F0R  INDEPENDENCE  0F  2 SETS  OF  VARIATES** 


ENTER  THE  DIMENSION  0F  THE  RESPONSE 

6 

ENTER  THE  NUMBER  OF  VARIATES  IN  1ST  SET 

2 ' ' 

ENTER  THE  NUMBER  OF  VARIATES  IN  2ND  SET 
4 

ENTER  THE  SAMPLE  COVARIANCE  MATRIX 

l«/*00/*«l 1 / •01/**04/  *76 

• 01^ 1 • / *66/ — *49/ • 56/ *07 

•*•1  1/  *66  / 1 • / - • 2 1 / *72/  - *04 

•01/ - *49/ -•21/ 1 •/ -*26/-* 1 1 

••04/ • 56/ • 72/ - • 26/ i •#••08 

•76/ .07/ • *04/ - • 1 1 / - *08/ 1 • 

"ENTER  THE  INDEX  NRS  0F  1ST  SET  0F  VARIATES 
i/6 

ENTER  THE  INDEX  NRS  0F  2ND  SET  0F  VARIATES 
2/ 3/4/5 

ENTER  THE  SAMPLE  SIZE 
42 

ENTER  ALPHA 
.05 

**  DIMENSION  OF  THE  RESPONSE  = 6 
**  NR  OF  VARIATES  IN  1ST  SET  ■ 2 
**  NR  OF  VARIATES  IN  2ND  SET  = 4 
**  SAMPLE  SIZE  = 42 
**  ALPHA  =.05 

**  REARRANGED  COVARIANCE  MATRIX  *♦ 


1 .0000 

.7600 

0.0000 

-.1 100 

.0100 

-.0400 

.7600 

1 .0000 

.0700 

-.0400 

-.1  100 

-.0800 

.0100 

.0700 

1 .0000 

.6800 

-.4900 

.5600 

-.1100 

-.0400 

.6800 

1 .0000 

-.2100 

.7200 

.0100 

-.1 100 

-.4900 

-.2100 

1.0000 

-.2600 

- .0400 

-.0800 

.5600 

.7200 

-.2600 

1 .0000 

**  TEST 

STATISTIC  - 4. 

1 630 

**  CRITICAL  VALUE 


15.5072 


**  HENCE  FAIL  TO  REJECT  INDEPENDENCE;  ** 
.232  CP  SECONDS  EXECUTION  TIME 
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* 


101 

103 


20 

105 


21 

107 


22 

109 


23 

111 


24 

113 


25 

115 


26 

117 


27 


29C 

300 

121 

122 

123 

124 

125 

126 
127 


PROGRAM  I NDSETC INPUT* OUTPUT, TAPE5-INPUT* TAPE6-0UTPUT) 

INTEGER  POSC 20  ) 

DIMENSION  R1 1 C20*20)*R22C20*20) 

DIMENSION  RC  20*  20 )*  CC  20  *20  )*JDC20>* I PRC  20 ) 

EXTERNAL  VI PDA 
VRITEC6* 101 ) 

FORMATS 1HI *2X*"**TEST  FOR  INDEPENDENCE  OF  2 SETS  OF  VARIATES**") 
WRI TEC  6 * 103) 

FORMATC /*2X*" ENTER  THE  DIMENSION  OF  THE  RESPONSE") 

READC  5*  * ) NL 
IFCE0FC5))  995*20 
VRITEC6* 105) 

F0RMATC/*2X* "ENTER  THE  NUMBER  OF  VARIATES  IN  1ST  SET") 

READC  5*  * ) N 1 
IFCE0FC5))  995*21 
VRITEC6* 107) 

F0RMATC/*2X* "ENTER  THE  NUMBER  OF  VARIATES  IN  2ND  SET") 

READC 5* *)  N2 
IFC  EOF C 5 ) ) 995*22 
VRITEC6* 109) 

FORMATC /*2X*" ENTER  THE  SAMPLE  COVARIANCE  MATRIX") 

READC5**)C  CRCI*J)*J*l*NL),I«l*NL) 

IFC  EOF  C 5 ) ) 995*23 
VRITEC6* 111) 

F0RMATC/*2X* "ENTER  THE  INDEX  NRS  OF  1ST  SET  OF  VARIATES") 
READC5**)  CPOSCD*  1 = 1 *N1  ) 

IFCE0FC5))  995*24 
VRI TEC  6* 113) 

FORMATC /*2X* "ENTER  THE  INDEX  NRS  OF  2ND  SET  OF  VARIATES") 

N3-N1 +1 

READC 5**) CP0SC I )*I-N3*NL) 

IFCE0FCS))  995*25 
VRITEC6* 115) 

FORMATC /*  2X*" ENTER  THE  SAMPLE  SIZE") 

READC 5**)  NS 
IFCE0FC5))  995*26 
VRI  TEC  6*  1 1'7  ) 

FORMATC /*  2X*"ENTER  ALPHA") 

READC 5**)  ALPHA 
IFCE0FC5))  995*27 
D0  300  I C-  1 * NL 
I A— P OSC 1C) 

DO  290  JC=1*NL 
JA=P0SC JC) 

CC  IC* «JC)*RC  IA*JA) 

CONTINUE 
CONTINUE 
WP.ITEC 6 *121)  NL 

FORMATC /*5X*"**  DIMENSION  OF  THE  RESPONSE  -"*12) 

VRI TEC 6* 1 22 ) N1 

FORMATC /,5X*"**  NR  OF  VARIATES  IN  1ST  SET  «"*I2) 

VRITEC6* 123)  N2 


FORMATC  /*  5X*  •’**  nr  OF  VARIATES  IN  2ND  SET  -"*12) 
VRITEC6* 1 24)  NS 

FORMATC /* 5X*"**  SAMPLE  SIZE  -"*13) 

VRI TEC  6* 125)  ALPHA 

FORMATC /*  5X*"**  ALPHA  *"*F3.2) 

VRI TEC  6* 1 26 ) 

FORMATC /* 5X*"**  REARRANGED  COVARIANCE  MATRIX  **") 
FORMATC /*  2X* 8 C 1 X*  F6 .4 ) ) 

DO  200  1-1 ,NL 
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WRITE! 6* 127)!C!I*J).J*1.NL) 

200  CONTINUE 

DO  400  IC*1,N1 
D0  390  JC-l,Nl 
R11!IC*JC)*C!IC*JC) 

390  CONTINUE 
400  CONTINUE 

DO  500  IC-1..N2 
IA-N1+IC 
DO  490  JC«1,N2 
JA-N1+JC 

R22C IC, JC)*C! I A, JA> 

490  CONTINUE 
500  CONTINUE 
YN1 =N1 
YNS-NS 
YN2  *N2 

V 1 * YNS - ! YN 1 +YN2  + 1 . ) /2  . 

CALL  CHSDEC  ! C/20..NL4  JDsDl *VIPDA> 

DET-D1 

DO  10  I«1/NL 

10  DET=DET*JD! I ) 

T*1 . /!  DET*DET> 

CALL  CHSDEC!R11«20*N1> IPR# D1 «VIPDA) 

DET-D1 

DO  11  I*1,N1 

11  DET=DET*1PR ( 1 ) 

El-1 . /( D£T*DET> 

CALL  CHSDEC!R22s20sN2.» IPR*D1 #V1PDA) 

. DET-D1 

DO  12  I*1,N2 

12  DET*DET*IPR! I ) 

B2-1 . /!  DET*DET) 

CVT«-AL0G!T/!B1*B2  ) >*V1 
A1DF-N1*N2 

ALPHA* 1 .-ALPHA 

CRIT*P1 CHI !ALPKA#A1DF« IR) 

IF! IR.EQ.l .0R.IR.EC.2)  GO  TO  995 
WRITE!6. 131)  CUT 

131  FORMAT C /*  5X>"**  TEST  STATISTIC  *,,#F10.4) 

VRITE( 6s 1 33  > CR1T 

133  FORMAT!  / 1 5Xs"**  CRITICAL  VALUE  -,,,F10.4) 

I F ( CVT .GT.CRIT)  GO  TO  800 


WRITE!6s  13$> 

135  FORMAT!  /.» 5X#  •’**  HENCE  FAIL  TO  REJECT  INDEPENDENCE 
GO  TO  900 

600  WRITE! 6s 1 37  > 

137  FORMAT!  / » 5Xs’***  HENCE  REJECT  INDEPENDENCE  **”> 


APPENDIX  D 

This  appendix  contains  a complete  FORTRAN  IV  listing 
of  a program  used  to  test  whether  a set  of  responses  is 
independent  using  the  results  of  (2.27).  The  program  is 
interactive  and  the  input  is  in  free-field  format.  An 
example  of  its  use  is  also  given. 
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**  TEST  F0R  COMPLETE  INDEPENDENCE  ** 
ENTER  DIMENSION  OF  THE  RESPONSE 

4 - - 

ENTER  THE  SAMPLE  CORRELATION  MATRIX 
1 •/ • 68# - • 49  # *56 
• 68  #1##-.21#.72 
•#49/“«21 j 1 •#>•26 
•56# . 72# - .26# 1 • 

ENTER  THE  SAMPLE  SIZE 
42 

ENTER  ALPHA 
.05 

**  DIMENSION  OF  THE  RESPONSE  ■ 4 
**  SAMPLE  SIZE  - 42 

**  ALPHA  ®.050 

**  CORRELATION  MATRIX  ** 

1.0000  .6800  -.4900  .5600 

.6800  1.0000  -.2100  .7200 

-.4900  -.2100  1.0000  -.2600 

.5600  .7200  -.2600  1.0000 

THE  VALUE  OF  THE  TEST  STATISTIC  » 65.81137 

THE  CRITICAL  VALUE  - 12.59120 

**  HENCE  REJECT  INDEPENDENCE  ** 

.075  CP  SECONDS  EXECUTION  TIME 


•-jv; 
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PROGRAM  INDEPC INPUT*  OUTPUT* TAP E5 • INPUT* TAP E6 "OUTPUT) 
DIMENSION  RC20.20)*UD(20>* I PR (20) 

EXTERNAL  VI PDA 
VR1TEC6* 101 ) 

101  FORMATC  1H1*5X*”**  TEST  FOR  COMPLETE  INDEPENDENCE  **”> 
VR1TEC6* 103) 

103  FORMATC /* 2X* "ENTER  DIMENSION  0F  THE  RESPONSE” ) 

READC  5*  * ) NL 
IFCE0FC5) ) 999*90 

90  UR1TEC6* 105) 

10S  FORMATC /*2X*” ENTER  THE  SAMPLE  CORRELATION  MATRIX”) 

READC  5*  *)CCRC1*U)*U*1*  NL)  * 1*1*  NL) 

IF C EOFC 5) ) 999*93 
93  VR1TEC6* 107) 

107  FORMATC /*2X*” ENTER  THE  SAMPLE  SIZE”) 

READC  5*  * ) NK 
I FC EOFC 5) ) 999*91 

91  VRITEC  6*  109) 

109  FORMATC /*2X*” ENTER  ALPHA”) 

READC 5**)  ALPHA 
IFC EOFC 5) ) 999*92 

92  VRITE( 6*121)  NL 

121  F0RMATC /*  5X*”**  DIMENSION  OF  THE  RESPONSE  «”,I2> 

VRI TEC  6*1 25 ) NK 

125  FORMATC /*5X*”**  SAMPLE  SIZE  *”*I4> 

VR1TEC 6* 1 27 ) ALPHA 

127  FORMATC /*5X*”*»  ALPHA  »”*FA.3) 

VRITEC  6* 122 ) 

122  FORMATC //*5X*”**  CORRELATION  MATRIX  **”) 

D0  200  I * 1 * NL 

VRI  TEC  6*  123)CRCI*«J)*«J*1*  NL) 

123  FORMATC /*  2X* 10C1X*F6.4)> 

• 200  CONTINUE 

ALPHA* 1 .-ALPHA 

CALL  DEC0MCR*20*NL* JD*IPR*D1 *V1PDA) 

DET*D 1 

DO  10  1*1 *NL 
10  DET»DET*RC 1*1) 

ED*ALOGC  DET ) 

YN-NK-1 
YM*C2*NL+5) 

YM-YM/6. 

YN—CYN-YM) 

CHISQ-YN*ED 
AIDF*CNL*CNL-1 ))/2. 

CV»P I CH I C ALPHA* A IDF* 1R) 

1FC IR.EO. 1 .0R.IR.EQ.2)  GO  TO  900 
VRITEC6* 111)  CH ISO 

111  FORMATC /*5X*”THE  VALUE  OF  THE  TEST  STATISTIC  *”*F10.5) 
VRITEC 6* 113)  CV 

113  FORMATC /*5X*” THE  CRITICAL  VALUE  -”*F10.5) 

IF C CH I SQ • GE • CV)  GO  To  800 


115 

WR1TE(6j 115) 
F0RMATC  /#  5Xj**** 

HENCE 

800 

G0  T0  900 
VR1TE(6«  117) 

117 

F0RMATC  / 1 5X/*'** 

HENCE 

900 

C0NTINUE 

999 

C0NT1NUE 

END 

FAIL  T0  REJECT  INDEPENDENCE 

REJECT  INDEPENDENCE  **"> 


**•’) 
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